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Abstract 

We consider systems of recursively defined combinatorial structures. We give algorithms checking 
that these systems are well founded, computing generating series and providing numerical values. 
Our framework is an articulation of the constructible classes of Flajolet & Sedgewick with Joyal's 
species theory. We extend the implicit species theorem to structures of size zero. A quadratic iterative 
Newton method is shown to solve well-founded systems combinatorially. From there, truncations of 
the corresponding generating series are obtained in quasi-optimal complexity. This iteration transfers 
to a numerical scheme that converges unconditionally to the values of the generating series inside 
their disk of convergence. These results provide important subroutines in random generation. Finally, 
the approach is extended to combinatorial differential systems. 
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Introduction 



Generating series play a central role in enumerative combinatorics. They obey functional equations 
derived from decompositions of combinatorial structures. These equations offer a route of choice to the 
enumeration sequences of these structures: they let one compute the first terms of these sequences, they 
sometimes lead to a closed formula for the nth term, and often to its asymptotic behavior. Reference 
books on this topic include Stanley's Enumerative Combinatorics [28, 29], the treatise on species theory by 
Bergeron, Labelle and Leroux [2] and the recent Analytic Combinatorics by Flajolet and Sedgewick [10]. 

We explore this area from the computational perspective. We present an algorithmic toolkit that starts 
from a system of recursive combinatorial equations and produces an efhcient computation of enumeration 
sequences and numerical values of the corresponding series. The central idea is to provide an iteration 
scheme converging to the combinatorial solution, and transfer this iteration scheme, both at the series 
and numerical levels. 

Our work is motivated in particular by the needs of random generation in discrete simulation. The 
recursive method [11] requires the coefficients of generating series for indices up to the size of the objects 
being generated. This method is exact, in the sense that it inputs a size and returns an object of that 
size, uniformly at random among all objects of its size. The more recent Boltzmann sampler [8, 9] can 
draw much larger objects with this uniformity property, the size itself becoming a random variable. This 
sampler relies on an oracle, that computes numerical values of the generating series inside their disk of 
convergence. We provide such an oracle for a large class of combinatorial structures and also give fast 
algorithms for the computation of enumeration sequences. 

We articulate the combinatorial framework of species [2, 14] with the framework of constructible 
classes [10]^: our results hold for combinatorial structures defined by systems of equations using the 
operations of union (denoted by '+'), Cartesian product (denoted by '•'), grouping in a set (Set), a 
sequence (Seq), or a cycle (Cyc), possibly with cardinality restrictions. There are actually two enumer- 
ation problems for such combinatorial classes. The labeled one deals with structures whose individual 
atoms are all considered as distinct. In the unlabeled enumeration problem, the individual atoms are 
considered as identical, and it is necessary to account for internal symmetries of the structures. Many 
recursive structures fall into this framework; numerous examples can be found in the literature, see e.g., 
[2, 10, 29]. Illustrations in this article are based on typical equations describing trees: T — Z ■ Seq(T) 
for Catalan trees, i.e. planar trees whose nodes have unbounded arity; Q = Z ■ Set{Q) for Cayley trees, 
i.e., unordered rooted trees; and a system describing series-parallel graphs: 

{C = Z + S + V,S = Seq>2(Z + V),r^ Set>2(Z + S)}. 

(The precise meaning of these equations is described in Section 1.) 

Our main result concerning enumeration consists of algorithms that are quasi-optimal: their com- 
plexity is linear, up to logarithmic factors, in the size of their output. More precisely, we show that 
for any constructible class, the first N terms of both the unlabeled and labeled enumeration prob- 
lems can be computed in 0{N log N) arithmetic operations; the required number of bit operations 
is 0(iV^ log^ iVloglog A^) for the unlabeled problem and 0(7V^ log'^ iVlog log A^) for the labeled problem. 
We also give efficient numerical algorithms computing the values of the generating series of constructible 
classes inside their disk of convergence. 

The key tool in this work is a combinatorially meaningful Newton iteration. This originates in the 
work of Labelle and his co-authors [7, 18, 19]. The combinatorial basis of the iteration leads to a numerical 
iteration which is always convergent. In the classical numerical context, under good conditions, Newton's 
iteration converges to a root that depends on the choice of its initial point, usually close to the root. In 
our combinatorial context, we show that when started at the origin, the iterates always converge to the 
solution corresponding to the generating series of interest rather than to a closer one. This is illustrated 
in Figure 1, where for each value of z in an interval, we have plotted the real solutions (z, Co) of the 
system of equations over generating functions corresponding to a combinatorial structure Co, defined by 
a recursive combinatorial specification. The curve marked in red corresponds to the actual generating 
series for Cq. Newton's iteration converges to this solution, and the crosses in the zoomed area indicate 
the successive values of Newton's iteration starting from Co — 0, for z ~ 0.275. 

-'^ Except for the powerset operator, that we treat separately at the end of this article (§10.2). 
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Co = ZCiC2C-i{Ci + C2) 

Ci = z + zsmicici) 

C2 = z + z''SEQ{zcism{z))sm{C2) 

Cs = Z + Z{3Z + Z'^ + Z^CiC3)Sm{Ci) 




Figure 1: Combinatorial system (left); real values of Co solutions of the corresponding system of equations over 
generating series (middle), with the generating series in red and the other real solutions in blue, for values of z 
between and 0.35; zoom on the rectangular area and iterates of Newton's iteration started at (right). 



The use of Newton's iteration over power series is well-known to be very efficient in terms of complexity, 
leading to the best known algorithms for many operations and making it a standard tool in computer 
algebra [5, 12]. We show that the systems of equations for generating series of constructible classes 
can be treated this way, that the iterates converge quadratically to the generating series and that this 
computation can be performed in good complexity. We presented the basic ideas of Newton's iteration 
on combinatorial systems in the labeled case in [25]. In the unlabeled case, new difficulties arise since 
inner symmetries make different labeled objects become identical when the labels are removed. Ordinary 
generating series do not compose or differentiate well. This is dealt with using Polya operators, that are 
nicely explained using the theory of species of structures [2, 14]. For instance, the generating series of 
unlabeled Cayley trees above satisfies the functional equation 

G{z) = zexp 2^ — - 

Using the framework of species of structures, Labelle and his co-authors obtained Newton's iteration for 
this type of equation. In the case of Cayley trees, the resulting Newton operator is 

y^y + Seq(Z • Set(3^)) • (Z • Set(3^) - 3^), 

which yields the corresponding Newton operator for power series: 

Y{z)^Y{z) + ^^^l^J^, with B(z)^zexp(y^^ 

l-B{z) \ki ^ 

Iterating this operator starting from converges to G{z) by doubling the number of correct coefficients 
at each step. Such a convergence is called quadratic. 

Newton's iteration on species extends to systems. In this article, we also present an optimized Newton 
operator that requires fewer operations. For instance, the ordinary generating series of series-parallel 
graphs are given as solution to the system of functional equations: 

C{z)^z+S{z)+P{z), S{z) = - ^^-l-z-P(z), Piz) = exp I ^ + ^^''^ ] -l-z-S{z). 

l-z-P{z) yf^^ J j 

Our method yields a completely mechanical derivation of the following efficient iteration (where the upper 
brackets contain the indices of iteration, and mod z^ means that the series is truncated at precision N.) 



2" 



+ 1 



p[n+i] (^) ; - ypH {z)J^^ ^'\p-l-z- (z) - (z) ) "'"'^ ^ 



with s = (1 - z - P["l(z))-i mod p = exp I ^{z^ + ^["l(z^))/j j mod z^"""' 
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and i/'"+^l(.) = L/'"l(z) + t/'"l(z)((^ 

Initialized with ^M(z) = = and C7 (z) ^ Id, this iteration converges quadraticahy to the 

ordinary generating series Siz) — hm^l"l(z) and P{z) — hmP["l(z). 

Joyal's Implicit Species Theorem [14] provides the natural context for these operations. It gives 
conditions under which a square system of combinatorial equations admits a unique vector of species 
solutions, up to isomorphism. We extend the implicit species theorem to allow for structures of size 0. 
This covers all cases of constructible structures we are interested in, and we show that Newton's iteration 
solves them all. We also show that our definition of well-founded systems is essentially optimal and give 
an effective criterion to check whether a system is well-founded. In passing, we give a combinatorial 
interpretation to the iterates in Newton's iteration: they generate the structures of the solution by 
increasing Strahler number. In order to complete the bridge between species theory and the constructible 
classes of [10], we define constructible species and analytic species. From there, we prove the analyticity 
of both exponential and ordinary generating series of the constructible species and give the numerical 
versions of Newton's iteration. We also deal with the case of integral equations relevant to the study of 
ordered structures. 

From the point of view of constructible classes, our contributions are: efficient algorithms for enumer- 
ation (cor. 8.16, p. 37 and thm. 10.10) improving by a factor log the theoretical arithmetic complexity 
that can be deduced from the best previous result [30] ; an analysis of the bit complexity of this compu- 
tation for both ordinary generating series (cor. 8.19, p. 38) and exponential generating series (cor. 8.22, 
p. 39); numerical oracles for both exponential (th. 9.13, p. 43) and ordinary generating series (th. 9.15, 
p. 44); a criterion to decide whether a combinatorial system is well-founded (def. 5.3, p. 21) that is easy 
to implement; also possibly new is the proof that all constructible classes have an analytic ordinary gen- 
erating series (th. 9.9, p. 42). As regards random generation, the numerical computations give oracles for 
the Boltzmann sampler for all constructible classes, and with the algorithms for enumeration, we improve 
the precomputation stage of the recursive method so that this stage is no longer a limiting factor for the 
size of objects being generated. 

From the point of view of species theory, we mainly extend existing ideas to make them applicable 
to all constructible classes: we give a complete and self-contained presentation of Newton's iteration for 
implicit species, we treat truncated (cor. 6.8, p. 27) and nontruncatcd (th. 6.3, p. 24) variants of Newton's 
iteration for systems with species of size 0, as well as an optimized version (prop. 6.9, p. 28); we deal 
with polynomial implicit species in detail (sec. 4.2, p. 17); we extend the implicit species theorem to 
species of size (th. 5.7, p. 23); we define analytic species (def. 9.1, p. 39) as a first step towards analytic 
combinatorics with species; we completely solve integral systems with Newton's iteration (th. 10.8 p. 54). 

This article is structured as follows. Part I deals with the combinatorial side of the iteration. The 
basic definitions and properties in the theory of species are first recalled, so that this article is self- 
contained and can be used as a dictionary between the theory of species and the symbolic method of 
Flajolet and Sedgewick [10]. The proof of the implicit species theorem is given using the vocabulary of 
Bergeron, Labelle and Leroux [2]. Special classes of species are then presented, including constructible, 
flat and polynomial species. Then we consider implicit species with structures of size 0. We conclude 
this section by the combinatorial avatar of Newton's iteration. Part II deals with the computational side 
of this work. Section 8 is devoted to generating series. Again, we start by recalling the basic facts in 
the theory, then we present the iterations on power series, analyze their arithmetic complexity and show 
how the bit complexity can be maintained small. The numerical iteration is treated in Section 9. For the 
computation of numerical values to make sense, the generating series need to be convergent. Accordingly, 
we define a notion of analytic species and give its basic properties. In particular, constructible species 
are shown to be analytic. The iterations on power series are then transferred to the numerical domain, 
using ad hoc techniques to deal with Polya operators in the case of ordinary generating series. At this 
stage, all the main results have been presented. Section 10 extends many of these results to systems that 
occur when the integral operator is used to impose orders on the labels of the structures. We conclude 
by dealing with the strange case of powersets. 



ji/'"Vz)+Id-C/'"Vz)j modz^". 
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Notations 



We use boldfaced characters for vectors, matrices, or tuples of species; for example, a multisort species 
^(3^1,3^2, ■•■ ,3^fe) is written Hiy), where y stands for the vector (3^i, 3^2, ■ • • , 3^fc); ^ vector of 
multisort species {'Hi{y),'H2{y), ■ ■ ■ i'Hm{y)) is consistently written 'H{y). 

We use Gantmacher's notation ai-k to denote the fc-tuple (ai, . . . ,aj.). Thus, the species H{y) can 
also be written Hi:m{yi:k) if we need its dimensions explicitly. 

The coefBcient of in a power series f{z) is denoted 

Part I 

Combinatorial Systems 

In this part, we explore the combinatorial side of the iteration, within the framework of species of 
structures. In Section 1, we first recall basic definitions of the theory of species of structures in order to 
express Joyal's Implicit Species Theorem (theorem 2.1). Joyal's proof consists in showing that, provided 
some conditions on H are satisfied, the iteration 

3;["+ii =^(s,y["i) , j;["i = o (1) 

converges, and the limit is the unique solution of the system y = 'H{Z,y), y{Q) = 0, up to isomorphism. 
Section 2 is devoted to describing this proof, in the language of species (for which we follow [2]), and 
isolating some building blocks that are used in the rest of the article. 

Section 3 characterizes combinatorial systems that we call well-founded at 0, i.e. systems such that 
7^(0, 0) = and iteration (1) converges to a limit without zero coordinates. This constitutes the starting 
point for our extension of the Implicit Species Theorem that includes combinatorial systems allowing for 
structures of size (theorem 5.7). In Section 4, we first introduce polynomial species, which have a finite 
number of structures, and the corresponding notion of partially polynomial species in the multisort case. 
Section 5 then focuses on the general notion of well-founded combinatorial systems, where ?i(0, 0) is not 
necessarily 0, providing conditions for Joyal's iteration to converge in this case, and leading to a General 
Implicit Species Theorem (5.7). 

Joyal's iteration (1) is sufficient to derive algorithms for computing enumeration sequences and nu- 
merical values of generating series. However, it is well-known that Newton's iteration leads to much 
better efficiency, at least when it converges. Newton's iteration, lifted to species of structures, writes 

In Section 6, we show that Newton's iteration applies whenever the General Implicit Species Theorem 
holds. Finally Section 7 gathers some additional information on special classes of species useful from the 
analytic point of view of the second part of this article. 

1 Species Theory 

We gather here the basic facts of species theory that we use in this article. We begin by briefly introducing 
some vocabulary, and refer to the book by Bergeron, Labelle, Leroux [2] for more intuition and examples. 
A reader familiar with species theory may notice that our notations slightly differ from those in [2] : ours 
are borrowed from Flajolet and Sedgewick's Analytic Combinatorics [10] and are convenient to make a 
bridge between these two theories, in particular in sections 8 and 9. 

Definition 1.1. A species of structures is a rule that, for each finite set U produces a finite set J-[U]\ 
and for each bijection a : U ^ V produces a bijection J-[cr\ : J-\U] ^\V], in such a way that for two 
bijections a and r, J^[to(t] = J-[t\ oJ^[<j\ and J^pdfj] = Id^rj^/j (this is called the transport of structures). 
An element s of J-[U] is called an J--structure on U . The size of an J^-structure is the cardinality of 
its underlying set. An element of T\U] is graphically depicted as in Figure 2, with dots representing 
elements of U . 
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Figure 2: J'-structure. 



Figure 3: J^o CJ-structure. 



1.1 Explicit Species 

Species can be defined in different ways. A few special cases are explicit enough to be given directly (in 
each case, the transport of structures is obvious): the empty species, denoted by 0, is defined by 0[U] = 
for all U; the species 1, characteristic of the empty set, is defined by 1[U] — ii U and 1[0] — {0}; 
the species Z of singletons is defined by Z[U] = {U} if \U\ = 1 and Z[U] = otherwise. Among 
all nontrivial species, we specially focus on sets, sequences and cycles, that are basic constructors of 
combinatorial structures in the framework of [10]. Examples of structures are given by Figure 4. 

• The species of sets, denoted by Set is defined by Set[J7] — {U}. 

• The species V of permutations defined by VlU] — {ip : U U \ Vv £ U,3lu ^ U,ip{u) — v}. In 
particular Vn = ^'[{l, . . . , n}] denotes the set of permutations over {1, . . . ,n}. 

• The species Seq of sequences (or linear orders) can be described by Seq[0] = {0} and for U = 

{ui, . . . ,U„} ^ 0, Seq[[/] = {(Uo-(l), ■ • ■ ,"o-(n)) I cr G Vn}- 

• The species of cycles, denoted by Cyc, composed of cyclic ordered lists can be described by 
Cyc[0] and for U ^ 0, Cyc[U] = {cr \ a £ V[U] is composed of a unique cycle}. 




a. set b. permutations c. sequences d. cycles 



Figure 4: J"-structurcs on U = {1, . . . , 5}, with a. J" = Set, h. T = V , c. T ~ Seq, d. J" = Cyc. 



1.2 Operations on Species 

Many operations on species are defined, such as sum, product, substitution and differentiation. In this 
short presentation we only give the action on finite sets, the bijections obeying natural constraints. The 
sum of species is defined by 

where '+' in the right-hand side denotes disjoint union of sets. The symbol ^ is also used for sums of 
several species. The product of two species T and Q , denoted \yy T ■ Q or TQ , is given by 

{Ul,U2), 

U=Ui+U2 

where the sum is over all decompositions of J7 as a disjoint union and 'x ' on the right-hand side denotes 
the Cartesian product. 
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Let T and Q be two species such that 5[0] = (there is no ^-structure of size 0). Composition 
of J- with Q is denoted hy J- o Q or the {J- o t/)-structures are J- -assemblies whose members are 

^-structures, more precisely: 

7r partition of U pGtt 

A graphical description of the composition of species is given in Figure 3. Note that, using composition, 
the property t/[0] =0 is equivalent to ^(0) = 0. 

1.3 Relations Between Species 

Two species and G are equal if they produce the same sets and bijections. The definitions in the theory 
of species are set up in such a way that classical equalities of calculus still hold between species. More 
generally, equality leads to equations and systems, whose solutions we set to study in this work. 

An isomorphism from to is a family of bijections au : jF[U] — )■ 5[t/], that makes the expected 
diagrams commute, that is, for any bijection a : U ^ V between two finite sets and for any J^-structure s, 
g[a]{aij{s)) = av iJ^[o']{s)) . Even if weaker than equality, isomorphism implies that the structures 
possess the same combinatorial properties; hence, following [2], we say that there is a combinatorial 
equality between two isomorphic species and G, and write T = Q. For example, the combinatorial 
equality F — T[Z) holds for any species J". 

Another type of isomorphism exists between structures of the same species. Two J^-structures s and t 
over {l,...,n} are isomorphic when there exists a permutation tt e Vn such that J^[7r](s) — t. An 
isomorphism type of J^-structures over {1, . . . , n} is an equivalence class modulo this isomorphism. Such 
an equivalence class is also called an unlabeled J-"-structure of size n. 

The notion of equipotence that only replaces set equalities by bijections is even weaker: two species 
and g are equipotent when the numbers of J^-structures and C/-structures are equal on all finite sets; this 
is denoted hy = Q. A typical example is that of sequences and permutations: V = Seq but V ^ Seq 
since these two species are not transported in the same way along bijections. 

A species is a subspecies of G, denoted hy C G, when for any finite set U, J^[U] C G[U] and for any 
bijection a : U V, T[a] — G[o']\j^[u]- For T C G, the subtraction H = G — is defined by the equation 
G = T + H. When J- C G with G{0) = 0, the inclusion is preserved by composition with an arbitrary H: 
T-L o T (Z Ti, o G ■ Two species J- and G are called disjoint if for all finite sets t/, J-\U] n G\U] = 0. If the 
species J- and G are subspecies of H and they are disjoint, then J- + G C H. 

1.4 Derivative and Related Species 

The derivative T' of a species T is defined by J^'[?7] = + {t*:}], where ★ is an element chosen outside 
of U . For instance, derivatives of the explicit species introduced earlier are given by Table 1. 



species 





1 


Z 


A + B 


A-B 


Seq 


Set 


Cyc 


derivative 








1 


A' + B' 


A' -B + A-B' 


Seq • Seq 


Set 


Seq 



Table 1: Derivatives of classical species. 

An 'H'(Z)-structure can be interpreted as an "H-assembly where the element ★ (called a bud by 
Labelle [16]) marks one of the possible locations for a singleton Z (see Figure 5). 

For example, the derivative of the composition of two species is given by {J- o G)' = {J-' o G) ■ G' ■ The 
interpretation is the following: to replace one of the singletons oi J^oG by a one first marks the branch 
of the J-'-structure where this is going to take place and then grafts on this branch a t^-structure with 
one of its element replaced by a *, i.e., a ^'-structure (see Figure 6). 

For any species H and any two species Ad B, such that A{0) = 0, the following inclusion holds, up 
to isomorphism: 

HiA)DH{B) + H'{B)-{A-B). (2) 
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Figure 5: 'H'-structure. 



Figure 6: (J^ o C/)'-structure 



The interpretation is as follows: the structures on the right-hand side are either in 1-1(3), that is to say 
"H-assemblies of only S-structures; or in the disjoint species T-L'iB) ■ A whose structures are "H-assemblies 
whose members are S-structures, except for exactly one member which is an ^-structure and not a B- 
structure. Labelle actually developed a complete Taylor formula in this context [20] that generalizes this 
inclusion. 



1.5 Multisort Species 

Species can also be defined for structures constructed on sets with several sorts of elements, as for 
functions of several variables. Such a species is called a multisort species, and denoted by J-[Ui, . . . , Uk]- 
It produces a set from each fc-tuple of finite sets Ui, . . . ,Uk- Then, the size of a multisort structure is the 
sum of the cardinalities of its underlying sets. 

The operations of sum and product easily extend to multisort species. For composition, the multisort 
analogue is more complicated: we present for example the case of an "H-assembly of Gi and 52 structures, 
where is two-sort, while Qi and ^2 are unisort: 

n{gi,g2)[u]= ^ ^[^1,712] x [] x J] ^2^. (3) 

TT partition of U s^tti t^TT2 

TTi -|-7r2 — TT 

For instance, sums and products are special cases of multisort species: +{QitQ2)\U] = Qi\U] + Q2\U] and 
■{Qi,g2)[U] = Gip] ■ g2[U] are obtained by defining +[U,V] as {0} if either \U\ = 1 or = 1 and 
•[[/, V] as {0} when \U\ — \V\ = 1 and otherwise. Thus, in the sequel, we consider these operations as 
species. 

The notion of derivative also extends to multisort species: for a fc-sort species Hiyi-.k), one sets 

— [[/i, . . . , Uk] = npu . . . , (7,_i, u, + {*,}, c/,+1, ...,Uk]. 

A &H /93^i-structure can be interpreted as an "H-assembly where the bud -ki of sort i marks one of the 
possible locations for a 3^i-structure. Figure 7 illustrates the case of a two-sort species 'H{Z,y), where 
dots represent the species Z. For instance, the structures in the product species 

dn,„ d'H,„ fdn ' ^ 



are 'H-assemblies whose members are singletons and 3^-structures, except for one member which is a 
9?^/93^-structure (in the location for a 3^- structure), as depicted by Figure 8. More generally, a se- 
quence Seq {&H/dy[Z,y)) consists of trees built up by iterating this process. 

The derivative of a composition behaves as in the classical case. For example, the composition of the 
species F{X,y) with two unisort species Qi and Q2 is differentiated as 

{HQuQ2))' ^^■Q[ + ^^-Q'2- (4) 
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Figure 7: A structure of the species &H{Z,y)/dy 



Figure 8: ((?H/93^)^-structure 



1.6 Jacobian Matrix 

Matrices and vectors of species are defined as usual; they can hkewise be viewed as species whose structures 
are matrices or vectors, the size of a structure being the sum of the sizes of its components. The product 
of a matrix by a matrix or a vector is given by the usual rules, sums and products being replaced by 
sums and products of species. The identity matrix for species, denoted by Id, is naturally defined as the 
matrix whose entries are the species 1 on the diagonal and anywhere else. 

Let = (Hi:m) be a vector of m + 1-sort species, and let 3^ — [yi.m) be a vector of species. As 
in the classical case, the Jacobian matrix of the vector of species y) with respect to y, denoted 

by dH/dy, is the matrix whose entry {i,j) is dT-Li{Z ,y) / dy j for 1 < i,j < m. Finally, a matrix of 
combinatorial species is nilpotent if one of its powers is (all its entries are the species). The order 
of nilpotcnce (the minimal power such that is reached) is bounded by the dimension of the matrix, 
exactly like in classical linear algebra. 

Example 1. Series-parallel graphs are specified by (3^1,3^2) = «5P(Z, J^i, 3^2), with 



<^(7 V V \ - /^Seq>2(Z + 3;2)\ 



denoting by Seq>;j the species Seq restricted to structures of size at least k and similarly for SET>fe. 
Linearity of the derivative implies that 

^^^^^ = Seq>,_i(3^) X r X Seq(3^) + y* X Seq>,.i(3'), ^^^^^^ = SET>,^,{y) x y\ 

The Jacobian matrix is therefore 

dSP ( Seq>i(Z + 3^2) xy* X Seq(Z + 3^2) + 3^2* X Seq>i(Z + 3^2) 



dy \SET>i{z + yi)y.y{ o 

This matrix evaluated at {Z,y) — (0,0) gives ([j [j), which makes it nilpotent of order 1. Considering 
graphs that are either series or parallel graphs, leads to a system with a third equation 3^3 = 3^i +3^2- In 
this extended case, the 3x3 Jacobian matrix at {Z,y) = (0,0) is nilpotent of order 3. 



Combinatorial interpretation of the Jacobian matrix The Jacobian matrix plays an important 
role in the characterization of species implicitly defined by a system of equations 3^ = 'H[Z,y). Such 
a system can be seen as a set of rewriting rules stating how to construct the coordinates of y, and the 
Jacobian matrix S — d'H/dy encodes a valued dependency graph of the system. Each entry (i, j) of S 
expresses how the species 3^i depends on 3^j . 

The p-th power of the Jacobian matrix thus describes the paths of length p in the dependency graph. 
When J"^{Z, 3^) = (the matrix is nilpotent), the graph has no cycle; this will be a crucial condition for 
the finiteness of the number of structures in the solution (Prop. 4.2). The weaker condition J^^{0, 0) = 
is one of the basic conditions for the implicit species theorem to hold (Theorem 2.1). It corresponds to 
the absence of cycles preserving the size of structures. 



2 Joyal's Implicit Species Theorem 

This section is devoted to Joyal's implicit species theorem, which constitutes a pillar in the theory of 
species, since it gives a meaning to solutions of equations. Our interest in this presentation is an analysis 
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Figure 9: Left: graphical representation of y = H{Z,y). Right: an example of an 'H-rootcd tree. 

of the proof, aiming both at introducing notions and techniques on species that will be useful in the rest 
of our article, and at focusing on the hypotheses of this theorem, that we extend later. 

2.1 Implicit Species 

We consider vectors of species, implicitly defined by a recursive square system of combinatorial equations 
y — 7i{2,y), where y = (yi-.m) and 7i = CHi-.m) are vectors of species. The Implicit Species Theo- 
rem [14] requires hypotheses ensuring that such a system actually defines a species of structures. The 
first condition, 7^(0,0) = 0, is a restriction on species, implying that there is no structure on the empty 
set (we give conditions to remove this restriction in Section 5). The second condition, on the nilpotence 
of the Jacobian matrix, prevents from building infinitely many structures of the same size. 

Theorem 2.1 (Implicit Species Theorem [14]). Let H be a vector of multisort species, with ?i(0, 0) — 
and such that the Jacobian matrix d7i/dy{0,0) is nilpotent. The system of equations 

y = niz,y), where y = iyi..m) (5) 

admits a vector of species solution S such that S{0) — 0, which is unique up to isomorphism. 

The solution of the implicit system of Theorem 2.1 is the species of Ti-rooted trees, that is to say 
Ti-assemblies of ^-structures, that are, recursively, Ti-rooted trees. A graphical representation of such a 
system is given in Figure 9, together with a representation of a structure of its solution. A proof of this 
theorem is given in the next section. A generalization is given in Theorem 5.7. 

Joyal [14] and Labelle [17] give two different constructive proofs of the implicit species theorem. 
Whereas Labelle's proof is a generalization of the method of blooming, the original proof by Joyal follows 
the classical proof of the implicit function theorem, and asserts the existence and uniqueness of the 
solution of implicit combinatorial systems. Joyal's proof is obtained by constructing an iterated sequence 
of species that converges (slowly) to the solution. We extract the basic blocks from this proof; they are 
used further in the rest of this combinatorial section. 

2.2 Contact and Convergence 

Two (possibly multisort) species J- and Q have a contact of order p, denoted by J- —p Q, when there exists 
a species isomorphism from to Q<p, where J^<j, denotes the species IF restricted to J^-structures of 
size at most p. Similarly, IF>p denotes the restriction to structures of size at least p. 

Definition 2.2 (Convergence of a sequence of species). The sequence of species (3^["')ngN converges to 
a species y if for all p > 0, there exists TV > such that for all n > iV, 3^1"! =p y. This is denoted 
by lim„^o, J^N - y. 

In addition, a sequence of species (!V'"')nGN is increasing if 3;["-il c 3^["1, for all n > 1. 

Lemma 2.3. Let (3^f"l)ngN be a sequence of species and let («„)„£« be a sequence of positive integers such 
thaty^''^ =„„ 3; ["+!]. //lim ji—^^Un — 00, then there exists a species y to which the sequence (3^^^^^)nGN 
converges. This limit is unique up to isomorphism. 
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Proof. We define the species y by giving its values for all sizes p E N. Let thus p be a nonnegative 
integer. The limit of implies that there exists A'' such that for all n > N , Un > P- Therefore, for all 
such n, 3^["1 =p J^I"^!] —p---—p 3^[^1. As a consequence, for all n > N, J^I"! and J^'^l coincide on all 
finite sets of size p, as well as on all bijections between them. We then define their common values as 
those of y. The properties required oiy[Toa] and 3^[Idt/] then follow from the same properties for y^^h 
By definition of the limit, one then has lim„^oo 3^'"' = 3^- 

The existence of isomorphic limits is rooted in the definition of limits: a species W is another limit 
of (3^["1) if and only if 3^ =p W for all p> 0; this in turn implies the existence of a species isomorphism 
from y<:p to W<p for all p, which gives an isomorphism between y and W. □ 

Convergence of vectors or matrices of species is defined as component-wise convergence. The next 
building block in the proof of the implicit function theorem is the following. 

Lemma 2.4. Let {y^^^)neN be a sequence of vectors of species converging to y . If the sequence H{Z, y^"') 
also converges to y, then y is a solution of y = H{Z,y). 

Proof. In order to show that y = Ti{Z,y), it is sufficient to prove that both sides of the equation 
coincide on finite sets and their bijections, which follows from their convergence. □ 

2.3 Proof of the Implicit Species Theorem 

Joyal's proof of the Implicit Species Theorem (in the case when m = 1) is based on a sequence of species 
defined by a simple iteration. 

Proposition 2.5. Let y — Ti{Z,y) be a system such that Ti{0,0) = and the matrix dH/dy{0,0) 
is nilpotent. The sequence (iy'"')„gN defined by 

y["l=0 and =?i(^,y["l), n>0 (1) 

is convergent. 

Given this property. Lemma 2.4 shows that the limit y of the sequence (iV'"') of Proposition 2.5 is 
actually a solution of the system y = H{Z^ y). If «S is another solution of the system with «S(0) = 0, 
then <S =0 i^'"' =o y and by induction using Lemma 2.C below, S —k y^'^'^^ y for all A: > 0. Thus 
there exists a unique solution with <S(0) = 0, up to isomorphism. 

Proof of Proposition 2.5. The first step is to show that (y^^^) is an increasing sequence of species. This 
is proved by induction: for n — 0, the assertion comes from the definition of the species; then the 
inclusion ^["1 C ^["+^1 is preserved by composition with n: 'H{Z,y^'^^) C ?i (S, ^^I^+^l), and by 
definition of the iteration, this is ^^^"+^1 C ^["+21. 

The rest of the proof consists in showing that the sequence (iV'"') converges. This is a consequence 
of the following lemma, which states that p iterations of a species H with index of nilpotence p increase 
the contact. We denote by W the ith iterate oiy ^ 'H{Z, y). 

Lemma 2.6. Let H{Z^y) be a vector of multisort species such that 7^(0,0) = and the Jacobian 
matrix d'H/dy{0,0) is nilpotent. Let A. and 3 be two species such that 3 C A.. If 3 =k A, 
then 'W{Z, 3) =k+i 'H^{Z, A) where \ < p < m is the index of nilpotence of the Jacobian matrix. 

Proof. The idea is that if an 'H-rooted tree of the species ^^{Z.A) — 7i^{Z,3) had size < fc + 1, 
then one of its branches would contain a structure of {dH/dy{0,0))P, but this is 0. The subtraction 
(and all those that appear in this proof) is defined since inclusion is preserved by composition. We 
first show that, for i > I, any structure 7 belonging to Ti^{Z,A^} — H^{Z,3) with size at most fc + 1 
rewrites as a structure of d'H/dy{i),G){'W^^{Z,A) - 'H'^^{Z,3)). By definition, the structure 7 
is an Ti-assembly of 'H'^^(^, .4.)-structures. At least one of these structures, say /3, belongs to the 
species 'H^~^{Z,A) — 'H^~^{Z,3), otherwise 7 would be an 'H-assembly of 'H'~^(.Z, B)-structures, i.e., 
an 'H.^{Z, B)-structure. Since contact of order fc is maintained by composition, the hypotheses imply that 
H'^^^{Z, A) —k H^^^iZ, 3); thus f3 is of size > fc, that is exactly fc + 1, since 7 is of size at most fc + 1. 
Moreover, all the other structures composing the structure 7 are of size 0. But, given that H{0,0) = 0, 
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there is no "H-rooted tree of size and thus the structure 7 is an "H-assembly whose unique member is /?. 
Therefore, 7 belongs to the species d'H/dy{0,0){W~\Z,A)-W~\Z,B)). 

Iterating this, we deduce that a structure of size at most equal to fc + 1, and belonging to the species 
WiZ, A) - B), rewrites as a structure of {dU/dyiO, 0))p{A - B), which is 0. In other words: 

n''{Z,A)-W{Z,B)=k+iO. □ 

Lemma 2.6, with A = ^["+^1 and B = shows that y^''+P^ ^k+i y^''^+P+^^ where 1 < p < m. 

The proof of Proposition 2.5 is now concluded by invoking Lemma 2.3. □ 

Example 2. The species of Catalan trees is defined by the implicit equation T — Z ■ Seq(T), T(0) — 0. 
Figure 10 shows the structures (omitting the elements of the underlying sets) produced in the first five 
iterations of T'"^^^ = Z ■ Seq(T'"'). Rectangles enclose structures of a given size when all structures of 
the limit T with this size have been produced: for example iteration T^"*' contains all structures of the 
solution up to size 4; and iteration T'^' contains all structures of the solution up to size 5, i.e., T''"^' =5 T 















4" ''^ fi f ^ i. ^ j[ 








4- /J i f ^ i. j[ 





Figure 10: First iterations of T^''+^^ = Z ■ SEQ(r["l). 



3 Well-founded Systems at 

In this section, we are interested in systems of the form y — ^{Z, y) such that 7^(0, 0) — 0. We focus 
on the case when the convergent iteration defined by Equation (1) has a solution with no zero (empty 
species) coordinates. This type of combinatorial system, which we call well-founded at 0, is not only 
natural, but also easy to characterize. Section 3.1 gathers useful properties of empty species and how to 
detect solutions of systems with empty coordinates; Section 3.2 defines and characterizes combinatorial 
systems that are well-founded at 0. 

3.1 Empty Species 

The empty species plays the role of a zero in the theory of species. We first state an obvious property. 
Lemma 3.1. For any species ^ , the species and T are disjoint, ■ = ■ ^ = 0, and C 
Proof. These are direct consequences of the definitions. □ 
The next property is more combinatorial, in the sense that it relies on positivity. 

Lemma 3.2. Let Q = {Gi-.m) be a vector of (possibly multisort) species, such that Qi ^ and Gi{0) = 0, 
for i = I, . . . ,m. For any vector of species JF, if ^{Qi-.m) = 0, then ^ = 0. 
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Algorithm 0-coord: Detection of zero coordinates in the solution of a system 
Input: H = {T-Li:m)'- a vector of species such that 7^(0, 0) = and the 

Jacobian matrix dH/ dy{Q,Q) is nilpotent. 
Output: Answer to "Are there coordinates in the solution of the system 

y = H{zy)r 

begin 

Compute U ■.= W{Z,0) 
foreach coordinate C of LI do 
L if C = then return YES 
return NO 
end 



Proof. For simplicity of notation and without loss of generality, we consider the case when is a single 
two-sort species and Q is unisort. 

We assume that ^ and show how to build a nonempty ^"(^1, C/2)-structure. The hypotheses 
imply that there exists a multi-set V = (Vi,V2) such that T[V] ^ and two sets Ui and U2 such 
that g,[Ui] ^ 0, for i = 1,2. Let U = {{1} x Ui) + ■ ■ ■ + {{vi} x Ui) + {{1} XU2) + ■ ■ ■ + XU2) where 
vi and V2 are the cardinalities of Vi and V2. By construction, there exists a natural bijection between V 
and U, so that J-[U] ^ 0. Similarly, each {«} x Ui is in bijection with Ui so that x Ui] ^ and 

the same holds for 1/2- Thus, there exists a nonempty structure in the set 

J'[Ui,U2] X n^iIW X Ul] X [1^2 [{j} X U2I 

■1=1 j=l 

which shows that the species J^{Gi, G2) is not 0, in view of Equation (3). □ 

Example 3. The product species is not zero, thus ii A ■ B = 0, then one of or S is 0. 
As a corollary, the emergence of nonempty species in composition is restricted to the case when a com- 
ponent species turns from empty to nonempty. 

Corollary 3.3. Let A. and 3 be vectors of (possibly multisort) species; assume that 3 <Z A. and 
6(0) = ^(0) = 0. For any vector of m species JF, if ^{3) = and J" {-A) 7^ 0, then there exists 
i € {1, . . . , to}, such that Bi — and Ai ^ 0. 

Proof. Assume that the conclusion does not hold, that is, for all i £ {1, • • . ,to}, Bi = implies that 
Ai = 0. Assume without loss of generality that the nonzero coordinates of B are the first k ones, 
while Bk+i = ••• = Bm ~ Ak+i = ■■■ = Am = 0. The species Q{yi:k) ■— ^(3^i:fc,0) is such that 
g{Bi..k) = J^iB) = 0. By Lemma 3.2, ^ = and thus = g{Ai:k) = ^{A), a contradiction. □ 

Finally, we get an effective criterion for detecting the existence of zero coordinates in the solution of 
a combinatorial system. 

Lemma 3.4. Let H = {'Hi-.m) be a vector of species such that 7^(0,0) — and the Jacobian ma- 
trix d'H/dy{0,0) is nilpotent. The ith coordinate of the solution S of the system y — H{Z^y) is if 
and only if yl"^^ = 0, where 3^]™' is the ith coordinate of the rath element of the sequence defined by (1). 

Proof. If = 0, then J^f = 0, for all fc > 0. Conversely, let 3^|™' = and assume that 5, 7^ 0. 

Then, there exists k > m such that J^f'' = yl'^-^l) ^ and yf ^^'^ = niiZ,y^''~^^) = 0. By 

Corollary 3.3, this implies that there exists j ^ i such that J^j'^"^' 7^ and J^]*""^' — 0. This reasoning 
cannot be iterated more than to times, which implies a contradiction, that is A: < m. □ 

Lemma 3.4 leads to Algorithm 0-coord. Note that in practice, it is not necessary to compute the whole 
species 7i"\Z, 0) (which may become very large). Indeed, according to the proof, the only property we 
use, for each coordinate of the vector, is whether the species is or not. Thus, practically, we compute 
:F'"(S,0) instead of ?i'"(S,0), with T,{Z,y) being if Hi{Z,y) = and Z otherwise. This is 
essentially the same method as in Algorithm A of [32, p. 28], the zero coordinates being those with an 
infinite valuation. 
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Algorithm isWellFoundedAtO: Characterization of well-founded systems at 

Input: 'H = {Hi-.m)- a vector of species such that 7i{0, 0) = 0. 
Output: Answer to "Is the system y — y) well-founded at 0?" 

begin 

Compute J := dn/dyiO, 0) 

if J"™ = then return O-coordCH) else return NO 
end 



3.2 Well-foundedness at 

In Joyal's implicit species theorem, the nilpotence of the Jacobian matrix appears as a sufficient condition. 
In this section, we prove a converse of Joyal's implicit species theorem under the extra condition that the 
solution does not have any empty coordinate. 

Definition 3.5. Let H{Z,y) be a vector of species such that 'H(0,0) = 0. The combinatorial system 
y ~ 'H.{Z, y) is said to be well-founded at when the sequence (iy'"')„gN defined by 

j;[°l=0 and n>0 (1) 

is convergent and the limit S of this sequence has no zero coordinate. 

Requiring the solution of a recursively defined combinatorial system to have no zero coordinate is a 
natural combinatorial condition from the point of view of specification designers. In any case, Lemma 3.4 
shows that it is easy to detect. It is also easy to fix, by removing from the system the corresponding 
unknowns. 

Example 4- Here are a few examples of systems that are excluded by our definition although the iteration 
is convergent: 

— y = y. In this case, the Jacobian matrix at is not nilpotent (and the equation has an infinite 
number of solutions); 

— y = y + Zy. Again, the Jacobian matrix at is not nilpotent (still is its unique solution); 

— 3^ = zy. Here, the Jacobian matrix at is nilpotent (it is 0), but this equation is not well-founded 
at with our definition. 

We now state a nice and effective characterization of systems well-founded at (in our previous arti- 
cle [25] the characterization was wrong, omitting the pathological cases of solutions with zero coordinates). 
The associated effective procedure is Algorithm isWellFoundedAtO. 

Theorem 3.6 (Characterization of well-founded systems at 0). Let H = (Hi-.m) be a vector of species 
such that 71(0,0) — 0. The combinatorial system y = 71(2, y) is well-founded at if and only if the 
Jacobian matrix dH/ dy{0,0) is nilpotent and the vector of species ^['"1 defined by Equation (1) has no 
zero coordinate. 

Proof. One direction was proved along with the implicit species theorem and is a consequence of Propo- 
sition 2.5 and Lemma 3.4. 

Conversely, if the system is well-founded at 0, then Lemma 3.4 gives the condition on y'™'. We now 
show the nilpotence of the Jacobian matrix by contradiction. Let 7 be an «S-structure such that 7^ 7^ 
for i = 1, . . . , TO and let n be the size of 7. Assume that the matrix dH/dy{0, 0) is not nilpotent. Thus, 
for all g G N, there exists a nonzero structure /J^ in the species {dH/ dy{0,0)Y . By construction, the 
size of f3q is 0. Since none of the 7^ is zero, there are infinitely many <S-structures of the form • 7, all 

of size n, which prevents the sequence (iy'"'),ieN from converging and leads to a contradiction. □ 
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4 Polynomial Species 



We now extend the implicit species theorem to cases with structures of size 0. Control over the number 
of such structures is provided by polynomial species that we first present. This section and the next one 
can be skipped on first reading. 

4.1 Polynomial Species 

Definition 4.1. A (possibly multisort) species of structures T is polynomial if there exists n > such 
that T>n = 0. In other words, there are only a finite number of J^-structures. 

The following results provide two effective characterizations of those systems that admit a polynomial 
solution; the first one applies to a system whose solution may have zero coordinates and the second one 
gives another characterization when the system is well-founded at 0. While the second characterization 
seems to be clearer, the first one is needed in the next section, when 7^(0, 0) =/= 0. The corresponding 
decision procedure is Algorithm isPolynomial. 

Proposition 4.2 (Implicit Polynomial Species). Let H = (Hi-.m) be a vector of species such that 
7^(0,0) — and the Jacobian matrix dH/ dy{Q,0) is nilpotent. Let (y'"')„gN be the sequence of species 
defined by 

y[°l=0 and =?i(^,j;["l), n>0 (1) 

The solution S of the system y — 'H{Z,y) such that «S(0) — is polynomial if and only if yl™! is 
polynomial and = y["'+^\ , 

Note that under these conditions, the solution is given by 5 = y'™', or even more precisely, S = 
where p is the order of nilpotence of the Jacobian matrix. 

Proof First, if >'["1 is polynomial and y^"'^ = y^"'+'^'^ then is also polynomial. That the limit is 

polynomial follows by induction. 

Conversely, we show that if the solution is polynomial, then the system has a particular form: it is 
triangular, and the right-hand side of each equation does not depend on the variable it defines. This 
implies that the solution is reached in at most m iterations. 

If S has coordinates that are zero, they can be removed from the system without affecting the other 
coordinates. Thus, from now on, we consider that S has no zero coordinate. Let k be the largest integer 
such that yf'"' 7^ y''''^^'. In particular, this means that y^^^ = S. By definition of fc, the vector of species 
yW\ _ y[k~i\ j^g^g ^gg^g^ Qjjg coordinate that is not 0, say the zth. We show that the species H does not 
depend on y^. Differentiating the identity 'H{Z ,y^''^^'^) = H{Z,S) gives 

—(z,y^^-'^) ■ y^"-'^' + ^(s,>;['=-ii) = ^(z,s) s' + —iz.s). 
gyK ) ^ ^ dz^ ' dy^ ' ' dz^ ' ' 

Since y^^^^"^ c y^^^ — S, the above identity implies equality of the first terms (resp. of the second terms), 
so that the following inclusions are equalities 

^{2,y^'-'b . c ^{2,s) ■ y^'-'^' c ^{z,s) ■ s'. 

Thus, d'H/dy{Z,S) ■ {S' - y^''-^'^') = 0. Since the ith coordinate of (5 - y^''^^'^) is not while its 
value at is 0, its derivative is not either, so that d'H/dyi{Z,S) — 0. By Lemma 3.2, we conclude 
that dTi I'dyi — which indicates that 'H does not depend on yi . The same reasoning applies to all the 
nonzero coordinates of - y^^^^^ . We may assume, without loss of generality, that these are the last 
m — p coordinates of the vector; therefore, the system can be split into two distinct blocks: 

• an implicit strict subsystem (3^i:p) — Hi:p{Z, 3^i:p, 0, . . . , 0); 

• a nonrecursive block that defines (3^p+i:m) as functions of {Z,yi;p). 
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Algorithm isPolynomial: Detection of implicit polynomial species 

Input: H = (T-Li-m): a vector of species such that 7^(0, 0) = and the Jacobian 

matrix d'H/ dy{Q,Q) is nilpotent. 
Output: Answer to "Is the solution of ^ = 'H{Z,y) polynomial?" 
begin 

Compute U := 0) and V := 0) 

if (U = V and lA is polynomial) then return YES else return NO 
end 



lip ~ 0, then all the structures of the solution are produced hy 0) and thus /c = 1. Otherwise, since 

the vector (3^W-3^f-^^...,:yW -34'-'!) is equal too and (3^W^^^^ ^ (J^til), then (3^1^^- ^1) ^ {y^-'^) 
by construction and thus the same reasoning can be applied to the implicit subsystem with k replaced 
by fc' = fc - 1 which is the largest integer such that y^'' ' ^ y^'' 

At each step, k is either or decreased by 1 and the size of the implicit system is decreased by at 
least one; thus k < m. □ 



Proposition 4.3 (Characterization of Implicit Polynomial Species). Let y = H{Z, y) he well founded 
at 0. The solution S of the system y — H{Z,y) such that «S(0) = is polynomial if and only if the 
Jacobian matrix dH./ dy{Z,y) is nilpotent and the species H is polynomial. 

Proof. For any m > 0, the sequence defined by (1) satisfies 

y[m+i] _ y[m] ^ Q'H/dy{z,y^"'^) ■ - 

which expresses the fact that any y'™^^' -structure is an Ti-structure of y^™' -structures and at least one 
of them has to be in the difference y'™' - y^'^~^\ Iterating and using the inclusion J^''"' C y^''^^^ for 

all fc > 0, we obtain that j^i^+^i - c (dn / dy {z ,y^"''^)Y ■ (^^i^i - j;™). If d'H/dy{z,y) is 

nilpotent of order p < m, then the right-hand side is so that ^["'+^1 — ylH — S in this case. If 
moreover fi is polynomial, then as a finite iteration of polynomials, this is a polynomial. 

Conversely, if <S is polynomial without zero coordinates, then fi has to be polynomial: if for any n 
there exists an Ti-structure of size at least n, then H{Z^S) contains such an «S-structure. Also, when S 
is polynomial, the proof of the previous proposition shows that H has a triangular structure from which 
the nilpotence of its Jacobian matrix is apparent. □ 



4.2 Partially Polynomial Species 

The concept of polynomiality can be refined in the case of multi-sort species. We start with J^{Zi, Z2) 
a (mi -|-TO2)-sort species. For any .^-structure s, we denote by (resp. |s|2) the size of the first (resp. 
second) tuple of sets in the underlying sets of s. We also let ^=[k.n) denote the subspecies of such 
that, for any s G ^=(k.n)^ \^\\ — k and jsjj = n. Also natural is to define the species ^<[k,n) such that, 
for any structure s G ^<(k,n)^ l^li ^ ^ ^-nd |s|2 < n. 

Definition 4.4. The multisort species J^{Zi, Z-i) is polynomial in the sorts Z\ when, for all n > 0, the 

species J^=(.,„) = I]fe>o •^=(fc,n) polynomial. 

Example 5. The species Seq(Zi -|- Z2) is not polynomial in Zi or Z2, while the species Seq(Zi • Z2), 
though not polynomial (in .Z), is polynomial in Zi and Z2. 

The next question is to detect the partial polynomiality of the solutions directly from the system. 
Example 6. Only the first two of the following three equations 

y = ZiZ2Seq(3^), y = ZiSeq(3^Z2), 3^ = Z2 + yz^ 

have solutions that are polynomial in Zi. 

Again, we give an effective characterization of those systems having a partially polynomial solutions. 
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Algorithm isPartiallyPolynomial: Characterization of implicit partially 
polynomial species 

Input: ~ {Hi:m)'- a vector of species such that such that y = 7i{Zi, Z2,y) 

is well founded at 0. 
Output: Answer to "Is the solution of ^ = H{Zi. Z2,y) polynomial in Zi?" 
begin 

if H is not polynomial in Z\ then return NO 
else 

if isPolynomial(?i(Zi,0,>^))=NO then return NO 
else 

Compute Jo := 0, 5o(Zi)) 

if J™ ^ then return NO 

else 

Compute 5o := 0, 
for i from 1 to m do 
[_ if (<So)i 7^ and "H is not polynomial in yi then return NO 
L return YES 

end 



Proposition 4.5 (Implicit Partially Polynomial Species). Let H — [T-Li-.m) be a vector of species such 
that the system y = H{Zi^ Z2^y) is well founded at and let S{Zi, Z2) be its solution such that 
«S(0) = 0. The species S{Zi, Z2) is polynomial in Z\ if and only if 

1. the species S{){Zi) := S{Zi,Q) is polynomial; 

2. the Jacobian matrix d'H/dy{Zi,0,So{Zi)) is nilpotent; 

3. H is polynomial in Zi and for all i Cz {I, . . . ,m}, either the ith coordinate of Sq is or 7i{Zi,Z2,y) 
is polynomial in yi . 

This Proposition is turned into Algorithm isPartiallyPolynomial to decide the partially polynomial 
character of an implicit species. The specialized system y — Ti{Zi,0,y) can possibly define zero 
coordinates, thus we use Algorithm isPolynomial to check for the polynomial character of its solution. 
However, note that when this specialized system is well founded at 0, Proposition 4.3 can be used instead; 
moreover, the second condition in Proposition 4.5 is a consequence of the first one by Proposition 4.2 
and the test on jTo can be skipped. 

Example 7. Proposition 4.5 allows to conclude on the previous three equations: 

1. when H = ZiZ2Seq(3^), then Sq{Zi) = 0, and the derivative ZiZ2Seq(3^)2 is at (Zi,0,0), thus 
the solution is polynomial in Zi; 

2. when H = ZiSeq(3^Z2), then: Sa{Zi) — 1 + Zi ^ 0; the specialized system 3^ Zi is well founded 
at 0; the species fi is polynomial in (Zi,^), thus the solution is polynomial in Zi; 

3. when H = Z2 + yZi, the solution S ^ Z2 ■ Seq(Zi) is not polynomial in Zi. In that case, the 
derivative of H with respect to y is Zi which is not nilpotent at (Zi, 0, 0). 

The proof relies repeatedly on the preservation of partial polynomiality by composition. 
Lemma 4.6. Let T(Z\,Z2^y) and {Qi.m)iZi, Z2) be multisort species such that ^(0,0) = 0. // 

1. !F and Q are polynomial in Z\ and 

2. for all i Cz {1, . . . , m}, either Qi(Zi, 0) = or jF(Zi, Z2, y) is polynomial in yi, 
then the species !F(Z\, Q) is polynomial in Z\. 
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Proof. We prove the result when T and Q are single species and then, an induction on i gives that 
Tj{Zi, Z2, QiA, yi+i...m) is polynomial in Zi for each coordinate j of J^. 

Consider the subspecies of F{Zi, Z2tQ) whose structures are of size Any structure in this 

species is an J^-assembly of Zi-structures, S2-structures, and ^-structures. By definition, within the 
members of this assembly, at most n are .H2-structures and none of the t?-structures is of size larger than 
(.,n); thus, the following inclusion holds 

(J'(Zi,^2,S)) = (._„) C J'<(.^„^.)(Zi,^2,^<(.,n))- 

If J-{Zi^Z2,y) is polynomial in Zi and 3^, then J^<(.,„..) is polynomial, as is Q<(,^n)] since the poly- 
nomial character is preserved by composition, J^<( „ ■) (Zi, .Z2, t/<(.^„)) is also polynomial. Otherwise, 
if CJ(Zi,0) = 0, then all the ^/-structures are of size at least (.,1); thus J^<( „ ) (Zi, S2, tj<(._„)) C 
J^<( „ „) (Zi, .Z2, tJ<(..ri)). This last species is polynomial, as the composition of the two polynomial 
species J^<(.^„.„) and G<{.^n)- In both cases, for any n > 0, (J^(Zi, ^2j „) is polynomial and the 

result follows. □ 

Proof of Proposition 4-5. We first establish that conditions 1. to 3. imply that S is polynomial in Zi, 
and for simplicity, the proof is carried out with 22 reduced to a single sort. 

Assume that S(Zi, 22) is not polynomial in Zi and let n be the smallest size for which the species 
«5=(.^„) is not polynomial. By definition, any 5-structure of size is such that its ith coordinate is 

an Hi-assembly of <S-structures, say <i, . . . ,ti, such that \tj\2 < n for j = 1, . . . , £. If none of the tj is 
of size then all of them belong to the species „) which is polynomial. Since «S<( „)(Zi,0) = 

S={.,Q) = «5o, applying Lemma 4.6 with .= H and Q :— «S<(..,i) shows that there are only a finite 
number of such decompositions. Otherwise, only one of the tj is of size (., n) while all the other ones are 
of size (., 0), which means that they are «So-structures and so are si, . . . , Si_i, s^+i, . . . , s^. This implies 
that the «S-structure is of the form a ■ (3, with a E dH/dy{Zi,0,So{Zi)) and f3 G S, with \f3\2 = n. 
By the second hypothesis, applying Lemma 4.6 again, 'H(Zi, 0, <So('2i)) is polynomial in Zi and so is 
d'H/dy{Zi,0,So{Zi)). If p is the order of nilpotence of this matrix, the reasoning above cannot be 
iterated more than p times. Thus, there are only a finite number of <S^( „) -structures that decompose in 
that way. Then <S=(..„) is polynomial and S is polynomial in Zi. 

Conversely, assume that <S is polynomial in Zi. Then, by inclusion, Sq{Zi) is polynomial in Zi too. 
Assume now that the matrix dH/dy{Zi,0,SQ{Zi)) is not nilpotent. Then, for allq e N, there exists 
a nonzero structure 6q in the species {dH/dy{Zi,0,So{Zi)))'^; by construction, \Sq\2 = 0. Since the 
system we consider is well founded at 0, one can always find an «S-structure, say 7, such that 7^ 7^ for 
i = 1, rn; let (., n) be the size of 7. Then, there are infinitely many 5-structures of the form 5q ■ 7, all 
of size which prevents S from being polynomial in Zi; the contradiction implies that the Jacobian 

matrix is nilpotent. 

Regarding the third point, if fi is not polynomial in Zi, then there exist infinitely many Ti-structures 
of size {.,£,k) for some £ and k; and since the system is well founded at 0, one can always find an 
«S-structure u) without zero coordinates to build infinitely many <S-structures from ft and w, their size 
being {.,£',k'), with £' and k' depending on £, k and the size of uj, which prevents the species <S from 
being polynomial in Zi. Finally, assume that there exists i € {!,... ,m} such that the ith coordinate of 
Sg is nonzero and assume that the species Hi^Zi, 22,y) is not polynomial in 3^^. It means, on the one 
hand, that there exists a structure a; in 5 such that \u}\2 — (ti + ■ ■ ■ + ti^i + + t^-i + ■ • • -I- tm), and on 
the other hand, that there exist infinitely many Ti-structures of size {£i,£2, ki + ■ ■ ■ + ki-i -\- ■ -\- fc^+i -|- 
• • • -|- km). Then, from u) and these Ti-structures, it is possible to build infinitely many «S-structures of 
size (•, £2 + kiti -I- • • • -I- ki^iti^i + fc^+iti+i -I- • • • -I- k^tm), which is, again, a contradiction. □ 

5 General Implicit Species Theorem 

It is often the case that one defines a species by an equation or a system that does not satisfy the implicit 
species theorem directly. For instance, sequences (Seq) can be defined by the implicit equation 

y = nciz,y) ■.= i + zy, 
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for which '^£(0,0) = 1 7^ 0. Moreover, defining Seq as the hmit of the iteration 3;["+i] = HciZ^y^'''^) 
with =0 is not even possible at this stage, since the definition of composition in Section 1 demands 
that 3^["1(0) = 0. 

In the case of sequences, an easy way out is to define nonempty sequences as U = Seq — 1, which is 
possible since 1 C Seq. Setting y = 1 + U in the equation above gives a new equation U = Z(U + 1) 
to which the implicit species theorem can be applied. More work is needed to make this idea work in 
general. For instance, the system 

3^1 = 1 + 23^1, y2^i + yl 

can be subjected to the implicit species theorem only after the translation J^i = 1 + 3^2 = 1 + 1 + ^2- 
Thus a first stage of the derivation consists in isolating the value of the solution species at Z = 0. This 
solution is in turn given by an implicit system, which has to have a polynomial solution in order to 
define only a finite number of structures of size n. It turns out that this question can be solved in a 
unified manner, provided we first extend the definition of composition to a polynomial species composed 
with the species 1. Then it is possible to define a notion of well-foundedness for combinatorial systems 
allowing for structures of size 0, and we finally obtain an extension of the Implicit Species Theorem to 
those combinatorial systems. 



5.1 General Composition 

While the composition of species J- o Q in defined for arbitrary J- when ^(0) — 0, the composition 
with Q — 1 \s only defined when J- is polynomial, so that the result makes sense as a species. (See 
Joyal's [15]2; see also [2, p. 111-112]). 



Definition 5.1. Let be a polynomial species. The composition of F with 1 is defined as follows. 



0, \iU^0, 
Efc>o-^[{l'2, . . . otherwise. 



The sum in the definition is polynomial since T is polynomial and the equivalence classes are defined 
with respect to isomorphism of J^-structures (see §1.3). 

This definition extends to multisort species. We only give the statement for 2-sort species so as to 
avoid heavy notation. If the species J-{Z^y) is partially polynomial in Z, then its composition with 1 is 
defined by 

'0, 111^7^0, 
E^.>o J-[C/, {1, 2, . . . , fc}]/-, otherwise. 



T{i,y)[u,v] = 



Again, the sum is polynomial since J- is partially polynomial and the equivalence relation is now isomor- 
phism for the second set: s and t in J-\U, V] are equivalent if there exists a permutation a d Vk such that 
T[ld,a]{s) ^ t. 

Finally, since sums can be viewed as multisort species, the composition is more generally defined for 
J- o Q for polynomial T and arbitrary Q. For instance, if G{Q) — 1, the polynomial J^{X + y) can be 
composed with X = 1 and then with G{0) — 1- 

Many properties satisfied by the classical composition of species hold, and in particular the following, 
with the same proof as Lemma 3.2. 

Lemma 5.2. Let Q ~ {Gi-.m) be a vector of species such that Qi 7^ 0, for i = 1, . . . , m. For any vector of 
species Tiyi-.m), if ^{Qi-.m) = 0, then T = 0. 



5.2 General Implicit Species 

This section extends the definition of well-founded combinatorial systems to cases when 7^(0, 0) is not 
necessarily 0. It gives rise to Algorithm isWcllFoundcd to decide whether a system is well founded or 
not. This characterization then leads to our General Implicit Species Theorem. 

^bearing in mind that here we consider what Joyal calls especes finitaires. 
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Definition 5.3 (Well-founded combinatorial system). Let H he a vector of species. The combinatorial 
system y = 71(2, y) is said to be well founded when the iteration 

>;["1=0 and =?i(S,>;["l), n>0 (1) 

is well defined, defines a convergent sequence and the limit S of this sequence has no zero coordinate. 

In this definition, 'well defined' means that the composition of species is actually defined, that is, for 
each sort 3^^, either fi is polynomial in or 3^]"''(0) = for all n. 

The restriction on zero coordinates is quite natural and already appears in the more specific framework 
of combinatorial specifications considered in [32] ^. This allows, in particular, to give a characterization 
of well-founded systems by necessary and sufficient conditions. 

When y — Ti{Z,y) is a system such that 7^(0,0) ^ 0, we define a companion system with a new 
sort Zi marking the empty species, and show the relations between iterations on both systems; finally the 
original system is well founded if and only if its companion system is well founded at 0, with a solution 
that is partially polynomial in Zi. 

Definition 5.4. Uy = 'H{Z, y) is a system such that 7^(0, 0) ^ 0, its companion system is defined by 

y = K{Zi,Z,y), where K ^ n{z ,y) - n{0,Q) + Zin{0,Q). 

Theorem 5.5 (Characterization of well-founded systems). Let H = (Hi-.m) be a vector of species. The 
combinatorial system y = H{Z,y) is well founded if and only if 

1. the companion system y = K.{Zi, Z,y) is well founded at and, 

2. if the species Si{Zi,Z) is the solution ofy — }C{Zi, Z,y) with «Si(0,O) — 0, then S\(Z\^Z) is 
polynomial in Z\ . 

In this case, the limit of (1) is Si{l,Z). 

Proof. Assume that conditions 1. and 2. are satisfied. The existence of the solution <Si follows from 
the implicit species theorem, since y — K.{Zi, Z,y) is well founded at 0. Then Si is the limit of the 
sequence (7"'"') defined by 

r["l=0 and r'"+^l = /C(Zi,Z,rf"l), n>0. (6) 

For all n > 0, since 7"'"' C Si, the species 7"'"' is polynomial in Zi and can be composed with 1. 
By induction, we now show that y^^\Z) = T^'^\l,Z) for all n > 0. From there it follows that the 
iteration in Equation (1) is well defined. The property is clear for n = 0. Assume that it holds for n. 
Proposition 4.5 implies that for all i € {l,...,m}, either K.{Zi, Z,y) is polynomial in yi, or the ith 
coordinate of «Si(Zi,0) is 0; this means that the ith coordinate of 7~'"'(1,0) C «Si(l,0) is (applying 
Lemma 5.2). Thus, the composition of /C with 1 is possible in the following equation that proves the 
induction 

r["+ii(i,s) = K:(i,z,r["i(i,s)) = ?i(^,j;["i) = 

the second identity being given by the induction hypothesis. As a consequence, (iV^"') converges to the 
limit of (T'"1(1, Z)), that is S{Z) 5i(l, Z). Finally, the system y = K{Zi,Z, y) being weh founded 
at 0, the species Si has no zero coordinate and by Lemma 5.2, neither does <S. 

Conversely, assume that 3^ = H{Z,y) is well founded. If 7^(0,0) — 0, then K. = H and the two 
properties are trivially satisfied; therefore, we only consider the case when 7^(0,0) ^ 0. First, in order 
to check that y = K{Zi, Z,y) is well founded at 0, it is sufficient to check for the convergence of the 
sequence (7~^"')ngN, the other properties being inherited from Applying the second item of Lemma 5.6 
below, the convergence of (7"'"') follows from that of (y'"'). Let us now turn to the polynomiality of 
the solution. For each k, the convergence of y'"' and Lemma 5.6 imply that there exists n such that 
T^^l k) ~ {^i)=(.,k) E^nd moreover 7"'"^ is polynomial in Zi. Thus for each k, (<Si)=(._fc) is polynomial 
in Zi, which means that Si itself is polynomial in Zi. 

Actually, the definition in [32] does not forbid zero coordinates. However, the corresponding procedure to detect 
well-founded systems (Algo. B) rejects those with zero coordinates, which comes back to our definition. 
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Algorithm isWellFounded: Characterization of well-founded systems 



Input: = (Hi:„i): a vector of species. 

Output: Answer to "Is the system y = H{Z,y) well founded?' 
begin 

Compute K := UiZ, y) - ?i (0, 0) + Zi?i (0, 0) 
if isWellFouiidedAtO(/C)=NO then return NO 
else 

if isPartiallyPolyiiomial(7C)=NO then return NO 
else return YES 

end 



Lemma 5.6. Let y — 'H{Z,y) he well founded and y — K.{Zi,Z,y) be its companion system. 
Let {y^^^)neN (7~^"')ngN be the sequences defined by Equations (1) and (G). For all n,k > 0, 

1. r'"! is polynomial in Zi and y^"^\Z) = T^^'^l^Z); 

2. =^ rf|.^,) - rf =^ r["i =u r["+ii. 

Proof. The first point is proved by induction on n. The case n = follows from the definition. By 
definition, K. is polynomial in Zi. For each i £ {1, . . . such that 7~'"'(2i,0) ^ 0, Lemma 5.2 shows 
that 7~["'(1, 0) 7^ and by the induction hypothesis this is ^^["'(0). Iteration (1) being well defined shows 
that in this case H is polynomial in yi and therefore so is /C. Thus, by Lemma 4.6, the species T"'""*"^' 
is polynomial in Zi. Moreover, the composition of K, with 1 being well defined, one has 

r["+^i(i,s) = a:(i,s, = ?i(^,j;["i) = ^["+^1. 

Again by induction on n, the sequence (7"'"') is increasing and in particular 7~<| ^.-^ C T^^^'^^y 
Then, since 3;["1 =u one has T^^\ j^^{l,Z) = T^^'^]l){l, Z). Let I>„,fe be the species defined by 

- rf+'J) - rfj fe). By hypothesis I>„,fc(l,^) = ^^I^+^l - = and thus, applying 
Lemma 5.2, TDn.kiZi, Z) — 0, which rewrites as Xjl^' j,^ = T^<^^^y This implies in particular that 

k k 

' <k ^ ' <(k-i.i) ~ ' <{k-i,i) — ' <k ■ ^ 

i=0 i=0 



Example 8. Here is how the theorem proves that the system = 1 + Zyi , 3^2 = 1 + from above is 
well founded. Its companion system y = /C(Zi, Z, y) is defined by 

yi = zyi + Zi, y2 = y! + Zi. 

Using Theorem 3.6, the value of the Jacobian matrix dK/dy ~ ( o) implies that y — /C(Zi, Z, y) is 
well founded at 0. In order to check that the solution Si of the companion system is polynomial in Zi, we 
use Proposition 4.5. The second condition follows from the nilpotence of dK./ dy{Zi,Q,y) = {^2yi o)- 
Next, since K, is polynomial. Proposition 4.2 shows that <Si(Zi,0) is polynomial. In addition, K. is 
polynomial in Zi and y^ which is the third condition for the polynomiality of Si. 

On the contrary, the system yi = 1 + 3^23^1, 3^2 = 1 is not well founded. Its companion system 
y = K{Zi,Z,y) is defined by 

3^1 =3^23^1 + Zi, 3^2 = 2i. 

Once again, the well-foundedness of this system is easily checked but its solution is not polynomial in Zi 
since the Jacobian matrix dK/ dy{Zi,Q,y) = {^q^q) is not nilpotcnt. 

We can now state a general Implicit Species Theorem, concerning well-founded systems allowing for 
structures of size 0. 
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Theorem 5.7 (General Implicit Species Theorem). Let H = {T-Li-.m) be a vector of species, such that the 
system y — 71(2, y) is well founded. Then, this system admits a solution S such that S{0) — fi"^ (0,0), 
which is unique up to isomorphism. 

Proof. By Theorem 5.5, a solution is given by S{2) — Z), with S\ the solution of the companion 

system oiy = UiZ^y). It follows that 5(0) = <Si(l,0) = X;"(1,0,0) = ?i'"(0,0), where the second 
equality is a consequence of Proposition 4.2. 

Let us consider the shifted system y = Ti{Z,S{0) + y) — «5(0); note that the subtraction is well 
defined since 5(0) = ?i(0,5(0)) c ?i(^,5(0)) c ?i(^,5(0) + y). This shifted system satisfies the 
conditions of Joyal's Implicit Species Theorem 2.1 and for any species lA, solution of ^ = H{Z, y) such 
that U{0) = 5(0), the species Ll—U(0) is a solution of the shifted system and is at 0. By Theorem 2.1, 
this solution is isomorphic to 5 — 5(0), so that U is isomorphic to 5. □ 

In this generalized setting, it is also possible to characterize systems with polynomial solutions. 

Proposition 5.8 (General Implicit Polynomial Species). Let H ~ {'Hi-.m) be o. vector of species such 
that y ~ H{Z,y) is well founded. Let (3^'"')neN be the sequence of species defined by Eq. (1) and let 5 
be the solution of the system y = H{Z,y) such that 5(0) = 'H'"(0,0). The following three properties 
are equivalent: 

i) the species 5 is polynomial; 

ii) the species yl™' is polynomial and y''"' = 

Hi) the Jacobian matrix dH/ dy{Z,y) is nilpotent and the species H is polynomial. 

Proof. The first two properties are equivalent. Indeed, if then by induction this species 

is 5 and its polynomiality follows from that of y'™'. Conversely, if 5 is polynomial, then 5 — 5(0) is a 
polynomial solution of the shifted system y = 'H{Z,S{Q)+y)—S{Q), which is at and the conclusion 
is given by Proposition 4.2. 

We turn to the third property. Let us consider the companion system y — K.{Zi, 2,y) and its 
solution 5i. By definition, d'H/dy{Z,y) = dK/dy{Z,y) and is polynomial if and only if K is 
polynomial. Thus, by Proposition 4.2, in order to prove the equivalence of properties i) and Hi), it 
is sufficient to prove that 5 is polynomial if and only if 5i is polynomial. Since 5 = 5i(l,.H), that 
the polynomiality of Si{Zi,Z) implies the polynomiality of 5 follows by composition. Conversely, if 
5i(l,-E) is polynomial, then 5i(l,-E)>rf = for some d > 0. Thus, by Lemma 5.2, Si{Zi, Z)>d = 
and 5i = Si{Zi, Z)^(i is polynomial. □ 

6 Newton's Iteration 

In this section we show how Newton's iteration can be lifted combinatorially for the construction of the 
solutions of all well-founded systems y = 7i{Z,y) of combinatorial equations on species. Moreover, 
for an effective construction, the iteration can be computed on truncated species. This construction has 
quadratic convergence in the following sense. 

Definition 6.1. The convergence of a sequence {^^"'^)n>o to a (vector of) species is quadratic if the 
contact doubles at each iteration; more precisely, if .T-"'"' has contact of order k with JF, then ^1"+^] has 
contact of order 2fc + 1 with JF. 

For the case of one equation, such a combinatorial Newton iteration has been introduced by Decoste, 
Labelle and Leroux [7], who showed that the equation y = F{Z,y) is solved by 

^^[nj^sgQ j^g(2,y"i)^ • (j"(z,3^["i)-y"i), y°i = 0. 

The main point here is that given the initial point 0, not only does the iteration converge, but the 
limit is the desired value. Our proof relies on an extension of that combinatorial Newton iteration to 
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Figure 11: A typical structure of the inverse of the Jacobian matrix of Ti{Z,y). 



the case of well-founded systems. We use the simple combinatorial interpretation of "blooming", due to 
Labelle [16], for the inverse of the Jacobian matrix, that appears in Newton's iteration: 

Figure 11 shows a graphical representation of a typical structure of the inverse of the Jacobian matrix, 

dH OH dH 

as a sequence of flyi-structures, with consistent replacements of buds — — - ■ — — — ■ — — — ■ ■ ■ 

dyi^ 93^,2 dyi^ 

Definition 6.2. Let the system y = 'H{2,y) be well founded; its combinatorial Newton operator is 
defined by 

Arni2,y)^y+ (E(|y(^'>')) I ■{n{z,y)-y). (?) 



ifc>0 



Note that in general, Af-n is not a species but only a virtual species (see [2, Ch. 2.5]) because it is not 
necessarily the case that y C HiZ, y). However, we are only going to apply this operator to species for 
which this inclusion holds, so that only actual species will occur. 

6.1 Quadratic Convergence 

We now prove that Newton's iteration solves all systems to which the general implicit species theorem 
applies. We thus rely on the existence of a unique solution (Thm. 5.7), and show that Newton's iteration 
provides quadratic convergence to it. 

Theorem 6.3. Let y = 'H{2,y) be a well-founded system. The sequence 

:V["1=0 and =Ar«(S, >;["!), n>0 (Af) 

is well defined and converges quadratically to the solution S of the system with <S(0) = 'H'"(0, 0). 

Note that when 7^(0,0) 7^ 0, the first iterations may not have contact with S. However, the 
theorem states that this happens eventually (indeed for n < m, see Lemma 6.7), and that from this point 
on, contact is doubled at each step. 

Lemma 6.4. Newton's iteration is well defined, that is J^'"' C 'H(^,y'"') for all n e N. 

Proof. The proof of this inclusion is by induction. For n = this is a consequence of ^ being the empty 
species. If the property is satisfied for n, then we use Taylor's formula truncated at the first order (2) 
with A = and B = ^^["+^1 The required inclusion comes from the first summand of Af-ni^, y'"') 
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being y'"'. Thus we get 




k>0 



where in the second line we use the induction hypothesis to rewrite Ti{2 ,y^"'') and the definition of the 



We now observe that the species constructed by Newton's iteration do not overlap. 

Lemma 6.5. LetH{Z^y) he a multisort species and U a subspecies 0/71(2,14) . Then the species U 
and 



are pairwise disjoint. 

Proof. The proof is by induction on k. When fc = 0, this is obvious. Otherwise, a structure a of the 
species [dTi/ dy{Z,tl))'^ ■ {'H{Z,U) —U) can be decomposed as the product of two structures /3 and 6, 
with 13 e dn/dy{ZM) and d e {dU/ dy{Z M)f^^ ■ [UiZM] - U). This decomposition is unique 
and implies that 5 is not a W-structure (by induction). Since a is an T^-assembly which has ^ as a 
member, the structure a. does not belong to H{Z,U). Since the species H{Z,U) contains W, then a 
cannot be a W-structure. □ 

Next, we show that the application of Newton's operator improves the contact quadratically. 

Lemma 6.6. Let U be a subspecies of S , solution of the well-founded system y — H{Z,y). If tl is a 
subspecies ofH{Z,'il) and tl =k S, then M ■u{Z ^U) C S and M ■^{Z ,14) =2k+i <5. 

Proof. First, recall that in the multisort case, the contact is with respect to the sum of sizes of the 
underlying sets. 

Applying H on both sides oi U <Z S implies that H{Z,U) C «S; then a structure of the species 
d'H / dy {Z ,U){'H{Z ,U) — U) is an T^-assembly of W-structures and a unique {'H{Z,tl) — W)-structure 
that are all «S-structures. Thus, 



Then, an induction on k shows that all species of (8) are subspecies of S. By Lemma 6.5, they are 
distinct, so that their sum, namely M-y_{Z,'Ll), is also a subspecies of S. 

Let now a. be an «S-structure of size at most 2fc + 1. Since W is a subspecies of Mr^iZ^U), we 
only consider the case when a is not a lY-structure. By definition, a. is an 'H-assembly of 5-structures. 
If all the <S-structures composing a. are of size at most k, then they are W-structures and a. belongs 
to H{Z,L() — W C Af<n{2,l^)- Otherwise, at most one of the <S-structures composing a is of size 
larger than k: two or more would give a a size larger than 2fc + 1. Thus, a rewrites as f3 x S with 
/3 G dH/dy{Z,U) and 5 an «S-structure of size larger than k and at most 2k + 1. Applying recursively 
the same reasoning to 5 up to exhaustion, one has 5 G {d'H. j dy {Z ,t€)f {'H{Z,tl) — U), for some ^ > 
and thus a e A/'-h(S,W), which proves that A/'-h(.Z,W) =2fc+i «5. □ 

The proof of Theorem 6.3 is now concluded by induction from Lemma 6.6 and an initial contact 
provided by the following lemma. 



iteration to rewrite y 



a 




(8) 



dH 
dy 



{z,u) ■ {n{ZM)-u) c n{z,s) c s. 
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Lemma 6.7. Let H = {T-Li-m) &e a species such that the system y =^ H{Z, y) is well founded and let S 
be its solution. Then there exists p < m such that y^^^ = S{0) = 'H™(0, 0), where (iV^"') is the sequence 
defined by Eq. (AA). 

Proof. If the system is well founded at 0, then «S(0) = so that p = has the required property. 
Otherwise, as in the proof of Theorem 5.7, we consider the companion system y = K.{Zi, Z,y) 
with 1C{Zi,Z, y) = [niZ, y) ~ niO, O)) + Z^niO, O). The Newton operator associated to K is 



Ar^{z,,z,y)^y+[Y,(^^{z„z,y)) | {K{z„z,y)-y) 



, *;>0 



y+ (^E(|^(^'^))'j {niz,y)^y + {z,~i)H{oM^ 



Since the system y — H{Z, y) is well founded, its companion system is well founded at and has 
a solution Si{Zi, Z) that is polynomial in Zi. Then by induction, the sequence defined by 7"'*^' = 
and 7"^"^^' = A/'k;(Zi, 7"'"') consists of species that are polynomial in Zi and satisfies 7~'"'(1,^) = 
for all n > 0. 

The species 0) being polynomial, 0) = 5(0) = 'H"\0, 0) by Proposition 4.2. Moreover, 

since <Si(Zi,0) is a subspecies of Si{Zi,Z), it is a subspecies of T^"^^ as soon as its contact with Si is 
large enough. For such a value of p, T'^1(1,0) = «Si(l,0) = 5(0) = ^^[^'(O) and the conclusion of the 
lemma holds. In order to bound the value of p, we observe that for any n, XI(.Z,7"'"') C 7"'"^^' and 
conclude that p < m by Proposition 4.2. □ 

Example 9. For Catalan trees, Newton's iteration reads: 

yln+l] ^ y[n] _^ g^^^^: • SEQ(3^["1)2) • {Z ■ SEQ(J["1) „ y[n]y 

The first iterates are as displayed by Figure 12. Rectangles enclose structures of a given size, when for 
this size, all the Catalan trees have been produced. This is to be compared with the successive species 
obtained by a simple fixed point iteration (see Example 2). For instance, Newton's iteration produces all 
the trees of size 5 at its second step, while the previous iteration does not generate all of them before the 
fifth step. 



ym=0 



Figure 12: First iterates of Newton's iteration on Catalan trees 

Example 10. For series-parallel graphs (see Example 1), we give Newton's iteration only for the part 
concerning 5 := and V , the graphs themselves are obtained by adding Z := 3^2 to those iterates. 



-pln+l] 



E 

, k>0 







Set>i(Z + 5["1) 



Seq2(Z + 7'["1) -1^ ] /Seq>2(Z + 7'["1) -5[^ 

i^SET>2(Z + 5["l) - -pi' 



The first few iterates are given in Figure 13. 
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Figure 13: First iterates of Newton's iteration on series-parallel graphs 
6.2 Effective Computation 

Newton's iteration, as stated in Theorem 6.3 gives an infinite sequence that converges to the solution of 
the system. Moreover, Newton's operator also involves an infinite sum. In order to effectively compute 
structures by Newton's iteration, we give an alternative to Theorem 6.3 that involves truncated species. 

These truncated iterations are lifted to iterations over power series in Section 8, so as to get efficient 
algorithms. 

Theorem 6.8 (Truncated Newton iteration). Let y = H{Z^y), he a well-founded system and S its 
solution from Theorem 5.7. Let (iy'"')n>o be the sequence defined by 



y[°l=5(0) and = (Ar-„(S,j;["l) 



Then, for all n > 0, y^" 



Recall that S{0) = S^q itself is when the system is well founded at and can be computed by 
iterating 7^(0, y) from at most m times otherwise; in particular <S(0) = 'H™(0, 0) (see Lemma 6.7). 

Proof. For any fc > 0, one has the inclusion S<k ^ 71(2, S<k), since any «S-structure of size at most k 
is an 'H-assembly of «S-structures of size at most fc. Then, Lemma 6.6 applies with fc = 2" — 1 and by 
induction U = y^"^ = 5<fe. □ 



Computation of Newton's operator Newton's operator involves an infinite sum that we also com- 
pute using Newton's iteration. The inverse of a matrix A can be computed by Newton's iteration: 
j^ln+i] _ j^[7i] _ ^["l^^^H _ jfj) converges quadratically to the inverse of A. This idea goes back at 
least to Schulz [27]. This iteration also applies to matrices of species since all the operations involved 
have combinatorial interpretations. Thus, the inverse of the matrix Id — dTi/dy{Z,y^^^^) occurring in 
Newton's operator is obtained by: 

ui^+i] ^ k[^] . (^dn/dyiz^y^"^) ■ - (wW - id)) . (9) 

The proof of quadratic convergence is a simpler variant of the previous one. 



6.3 Optimized Newton Iteration 

We go one step further and improve the efficiency of the algorithm by lifting to the combinatorial setting 
a technique that saves a constant factor in the speed of Newton's iteration. The idea is to avoid spending 
too much time in the computation of the inverse of the Jacobian matrix. The optimization consists in 
computing only one iteration of the inverse by Eq. (9) at each step of the main Newton iteration. This 
optimized version of Newton's iteration is briefly explained below, and can also be found in [24]. 
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str=l 



str=2 



str=3 



Figure 14: Typical H-rooted trees with Strahler number 1,2 or 3. In the second and third pictures, trees 
having Strahler number equal to 1 are depicted by simple lines, as suggested in the first picture. 



Proposition 6.9. Let y ~ H{2,'y) be a well-founded system. The sequence (iy'"')n>o defined by 



yln+1] ^ y[n] _|_ ^["+1] . {'H{Z,y^"^) - y^' 



<2" + i-l 



(10) 

(11) 



with y^^^ = and — Id, converges quadratically to the species S, solution ofy = H{2,y). 



Main steps of the proof. A complete proof is given in [24]. We only give here a sketch of it. The first 
step is to show that this iteration is well defined, i.e., all subtraction signs correspond to inclusions. This 
is done by an induction on n showing that W'"] C Id + dU/dyiZ, >;1"I) • W^"! and iV'"! C ?i(^,y["l). 
The second step is to ensure that there is no ambiguity on the w'"^^'-structures. This comes from an 
induction showing that any sequence of structures of the species dn/dyiz^y^''^) - d'H/dy{z,y^'''-^^) 
is uniquely derived from Equation (10). Finally, quadratic convergence is given by an induction proving 
that =fe and =ik/2\ ^^"+^1 are sufficient to ensure that y'^''+^^ =2k+i and 



6.4 Characterization of the Iterates 

In the case of the simple iteration of Section 2, the "H-rooted trees are produced by increasing height. We 
now give a simple combinatorial interpretation of Newton's iteration using a generalization for 7^-rooted 
trees of the classical Strahler number (see, e.g., [31]). This is not used in the sequel. 

Definition 6.10. The Strahler number of a nonempty "H-rooted tree 7, denoted by str(7), is defined 
recursively. The structure 7 decomposes as an H-assembly with members 7i:q. If all the members of 7 
are singletons, i.e., 71 = • • • = 7^ = Z, then str(7) = 1. Otherwise, let M ~ maxi<i<g(str(7i)) be the 
maximum Strahler number of one of 7's members, then: 

^ ^ ^ 1 7\/ + 1 if 3i,j, such that i ^ j and str(7i) = str(7j) — M, 
I M otherwise. 



Proposition 6.11. Let H be a multisort species such that y = ^{Z^y) is well founded. Let {y^^'^)ke^ 
be the sequence of species produced by Newton's iteration starting from J^^^l — 0. Then, for any H-rooted 
tree 7.- 

Proof. By induction on k. The only 'H-rooted trees with Strahler number equal to 1 are the "H-assemblies 
whose members are atoms, that is the J^'^l-structures. Thus 7 € y^^^ 4=> str{j) = 1. 

If 7 e 3^['=+il - jl*^! , then 7 rewrites as a sequence /3i • • • • ,5, with l3j e dH/dy{Z, J^I'^l), j = 1, . . . , ^ 
and 6 G 'H{Z,y^^^) — y^^\ The structure 5 is exclusively composed of 3^1'''l-structures; by the induction 
hypothesis, their Strahler number is at most fc; thus, str((5) < fc + 1. Then j3i ■ 5 is an "H-assembly with 
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at most one member (the structure i5) whose Strahler number is < fc + 1 and the other ones (that are 
J^I'^l-structures) whose Strahler number is < k. Therefore, str((/3f • ^)) < fc + 1. Iterating this reasoning 
on the /3j's until j = 1, we get str(7i) < fc + 1. Since 7 ^ y^^\ the induction hypothesis implies that 
str(7i) > fc, for i = 1, . . . , m, which gives str(7) = fc + 1. 

If str(7) — fc+1, then 7 is an "H-assembly whose members have Strahler number at most fc and possibly 
one equal to fc + 1. If none of them has Strahler number equal to fc + 1, then 7 is an H(Z, y^^'^ )-structure. 
Otherwise, 7 is a structure of the form j3 ■ 5 with 13 € d'H/dy{Z,y^^^) and str((5) = fc + 1. Iterating this 
until 7 is exhausted, we obtain that 7 € 3^I'=+i]. Since str(7) > fc, the structure 7 does not belong to y^^\ 
and thus 7 e J^I'^+il - y^^^ . □ 

This result can be extended to any well-founded system y = H{Z,y), bearing in mind that Ti-rooted 
trees can be viewed as derivation trees of the combinatorial structures described by such a system. 

7 Special Classes of Species 

7.1 Constructible Species 

Even if the combinatorial properties stated in this part are applicable to all species, we introduce a 
restriction on species in order to give complexity results in Section 8. The restriction we impose is guided 
by the framework of constructible combinatorial classes [10], which we cast here into the species language. 

Definition 7.1. A constructible species is inductively defined as either: 

1. one of the basic species (see Table 3) in {1, Z, +, •, Seq, Cyc, Set, 3^1,3^2, • • ■ }; 

2. any basic species with a cardinality constraint that is a finite union of intervals; 

3. a composition of constructible species; 

4. the solution of a well-founded system y = H{Z, y), such that each coordinate of 'H is constructible. 
We call iterative constructible, the species defined by the first three rules only (i.e., without recursivity) . 
Example 11. All the examples in this article are constructible. 

7.2 Flat Species 

Flat species will prove useful in the next part, thanks to the nice properties of their generating series. 

An J-"-structure s on [/ is asymmetric if it does not have any internal symmetry. More precisely, for 
any permutation a oi U different from the identity, jF[a]{s) ^ s. 

Definition 7.2. Let be a species of structures. The flat part of F is the subspecies F oi F defined, 
for any finite set U ^hy F = {s € F\U] \ s is asymmetric}. 

This extends to multisort species, asymmetry being with respect to each sort. 

Example 12. The most basic cases are: Seq — Seq, Cyc — Z, Set = 1 + Z. 

A flat species is a species that is isomorphic to its flat part. For instance, the species of sequences is 
flat, whereas cycles and sets are not. 

Lemma 7.3. Let ^ be a k-sort flat species and Q = Qi± a flat species, then the species ^ o Q is flat. 

Proof. According to [2, Prop. 4, p. 323] and [22], for any species T and Q (not necessarily flat), 
T o Q (Z T o Q . Thus, the flatness of T and Q gives the following relations 

that lead ioT oQ ^ T oQ. □ 
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Proposition 7.4 (Implicit Flat Species). Let J^{Z,y) he aflat species, ify — ^{Z,y) is well founded, 
then its solution S given by Theorem 5. 7 is flat. 

Proof. By induction on the sequence {y^"^)n>a defined by = :F(^,y["l), using Lemma 7.3. □ 



Part II 

Computation 

We now turn to the computational part of our work and show that the combinatorial iterations transfer 
to both levels of generating series and numerical evaluation. Newton's combinatorial iteration directly 
transfers to the level of formal power series, the quadratic convergence being in terms of valuation. The 
strength of Newton's iteration in this context is that it makes it possible to compute the first n terms of 
the generating series in 0(n log n) arithmetic operations. Taking into account the combinatorial origin 
of the coefficients, we also show that the bit complexity is likewise quasi-optimal. When interpreted 
numerically, for a value of the variable inside the disk of convergence of the generating series, we show 
that the same iteration computes the values of the power series, in both cases of ordinary and exponential 
generating series. 



8 Formal Power Series 

In this section, we transfer Newton's iteration on a combinatorial system to iterations over generating 
series. This extends earlier work of Labelle's [19] to systems and to equations with 1. We also discuss 
several possible truncation orders. The quadratic rate of convergence of Newton's iteration leads to 
efficient enumeration algorithms, whose complexity we show to be quasi-optimal. 



8.1 Generating Series 

There are several formal power series associated to a species J-. The exponential generating series F{z) 
encodes the numbers of J^-structures on the sets {!,..., n}. This is called labeled enumeration. The 
ordinary generating series, denoted by F{z), is used for unlabeled enumeration; it encodes the numbers 
of isomorphism classes of J^-structures. Finally, a third kind of series, the cycle index series Zjr is a more 
general tool that gathers the information of both exponential and ordinary generating series. 



8.1.1 Definitions 

Definition 8.1. The exponential generating series of a species of structures J-" is the formal power series 



oo ^ 
7J- 



n=0 

where /„ = • • • , n}] \ is the number of J^-structures on a set of size n (also called labeled J^-structures 

of size n). 

Definition 8.2. The ordinary generating series of a species of structures J- is the formal power series 

oo 

#(z) = ^/„z" 

n=0 

where /„ is the number of unlabeled J^-structures of size n. 

In the case of asymmetric structures, the number of labeled structures of size n coincides with the 
number of unlabeled structures of size n multiplied by n!, so that for flat species (see Section 7.2), 
exponential and ordinary generating series coincide. 
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1 


Z 






Seq 


Set 


Cyc 


cycle 
index 
series 





1 


21 




Zjr ■ Zq 


1 


cxp 


\fc>0 / 




1-21 


fc>0 



Table 2: Cycle index series. (}p is Euler's totient function) 



Definition 8.3. The cycle index series of a species of structures is a formal power series in an infinite 
number of variables, defined by: 

zAzi,z2,z3,---)^Y.^i E &^J'[<tK'4'--], (12) 

n>0 ' \aeV„ I 

where cr^ is the number of cycles of length i in the cycle decomposition of the permutation a and fix J-'[fT] 
is the number of J-"-structures on {1, . . . , n} fixed by J'\a\. 

Table 2 presents the cycle index series of the basic constructible species. The following fundamental 
result relates these three generating series. 

Property 8.4. [2, Th. 8 p. 18 and (33) p. 112] A species of structures T has exponential generating 
series Zjr(z^ 0, 0, ... ) and ordinary generating series Zjr{z^ z^, z'^, . . . ). 

Table 3 presents ordinary and exponential generating series associated with basic constructible species 
(see [10] for more details.) 



species 


operator 




g = 1 


exponential g.s. 


ordinary generating series 


basic constructible species 


Disjoint union 
Cartesian product 
Sequence 


T + g 


T 



1 


-F+ 1 
T 


F{z) + G{z) 
F{z) ■ G{z) 
il-G(z))-' 


F{z) + G{z) 
F{z) ■ G{z) 
{1-G{z))-' 


Cycle 
Set 


CYc(e;) 
SET(e;) 




1 




^°Si_G(2) 
exp(G(2)) 


■sp , , 1 

^ k 1 - G(z'') 

k>0 ^ ' 
\k>0 / 


basic constructible species with a fixed cardinality 


f-tuple, ^ > 
Cycle, card ^ > 
Set of card ^ > 


SEQ,(g) 

CYCf(£;) 
SET,(e;) 







1 
1 
1 


G'{z) 

\G\z) 

iG\z) 


G\z) 

r v-^ <^(fc) , 1 

[u'] exp {uG{z) + ^0(2^) + ^G(2'^) + ■ ■ ■ ] 



Table 3: Generating series associated with basic constructible species. (The character "— " stands for "unde- 
fined"; other cardinality constraints are obtained by subtraction {> t) or finite unions (< £).) 

8.1.2 Derivative 

The cycle index series of the derivative of a species T is given by 

d 

Zjr,{zi,Z2,Z3,. . .) = —Zjr{zi,Z2,Z3,...). 

This leads to a simple formula for exponential generating series: F'{z) = dF{z)/dz. But there is no such 
relation for ordinary generating series: the computation of the ordinary generating series for a derivative 
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species goes by the cycle index series of the derivative: 

¥'{z) = Zr'{z,z\z\...). (13) 

In a way, this is why Newton's iteration for unlabeled enumeration is complicated: the sole knowledge of 
the system of equations over ordinary generating series is not sufficient to derive the Newton operator, 
which requires the derivative. (See the example of unlabelled Cayley trees in the introduction.) 

8.1.3 Composition 

The next fundamental result in the theory of species allows to compute cycle index series by composition. 

Property 8.5. [2, Th. 2, p. 43] Let T and Q he two species of structures and assume that Q{Q) = 0. 
The cycle index series of the species T o Q is 

Zjrog{zi,Z2,Z3, . . . ) = Zjr{Zg{zi,Z2, Z3,... ), Zg{z2, Z4, Zq, . . . ),Zg{z3, Zq, Zg, ...),...). 

This formula also holds when J- is a polynomial species and G = 1. This operation is sometimes called 
the plethystic substitution of Zg in Zjr. 

In view of Property 8.4, we deduce that for exponential generating series, the composition of species 
translates into the composition of series. 

In the case of ordinary generating series, the composition is more intricate: the ordinary generating se- 
ries of the composition of species is defined using operators that were studied by Polya [26]. Properties 8.4 
and 8.5 thus lead us to the following. 

Definition 8.6. The Polya operator ^jr of a species T is defined by 

■■ G{z) ^ Z^{G{z),G{z^),G{z^), ...) = Z^og{z, z^, z^ . . . ) 

It associates the ordinary generating series oi T o Q to that of G- As a special case, the ordinary 
generating series of a species J- is given by F(z) — $jf(z). Moreover, these operators compose by 

As implicit species are built by composition, the previous results ensure that systems defining implicit 
species translate into systems of functional equations on ordinary or exponential generating series. 

Example 13. The ordinary and exponential generating series T{z) of Catalan trees (see Example 2) 
are both defined by the functional equation T{z) — z/(l — T{z)) since the isomorphism type of this 
species is the species itself. The species of Cayley trees is defined by G — Z ■ Set(C/). Its exponential 
generating series is defined by G{z) — zexp(G(z)) whereas its ordinary generating series is defined by 

G{z) — z exp ^G{z) + ^Giz"^) + • • • j , using the Set operator given in Table 3. 

8.1.4 Generating Series for Multisort Species 

The definitions of ordinary, exponential and cycle index series extend to multisort species. One variable is 
used per sort, or one infinity of variables in the case of cycle index series. There is no technical difhculty 
but the notation becomes messier. The ordinary and exponential series are still deduced by simple 
specializations of the cycle index series. The plethystic substitution extends to the multisort context, 
which leads to the definition of Polya operators. We refer to [2, p. 106-107] for details. From now on, we 
use exponential and ordinary generating series, cycle index series and Polya operators both in the unisort 
or multisort context. 

8.2 Convergence of Iterations on Power Series 

The iterations on species of the previous part translate into iterations on generating series; the result- 
ing iterates then converge to the expected generating series since they are the generating series of the 
successive species produced by the combinatorial iteration. 

Recall that the valuation of a power series S{z), denoted by val(5'(z)), is the exponent of the first 
nonzero coefficient of the series. A metric is classically deduced by defining the distance between two 
power series by d{F{z),G{z)) = 2^™'(^(^)~'^(^)); the notion of convergence follows. 
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Lemma 8.7 (Transfer, series part). Let y = 'H.{Z, y) he well founded and ^ he a vector of species with 
exponential generating series (resp. Polya operator) F. If 

y[n+i] ^ ^(2, j;["i), with = 0, 

is an increasing sequence of species converging to the solution S of the system, then the sequence 

r["+il(z) = F(z, Y["l(z)), with r[°l(z) = 0, 
converges to the vector of exponential ( resp. ordinary) generating series S{z) ( resp. S{z) ) of the species S . 

Proof. Convergence of sequences of species translates in terms of valuation at the level of generating 
series into val {y^"\z) — S{z)^ — > oo, which gives the convergence of generating series. □ 

This lemma gives a simple algorithm to compute the first coefficients of generating series. Indeed, the 
fixed point iteration induced by any well-founded combinatorial system (choosing = in the previous 
lemma) is an automatic process to derive its associated counting series. But, as we have seen earlier, this 
iteration may be slow, meaning that in the worst case, several steps are needed to get one more correct 
coefficient. We now consider the faster convergence provided by Newton's iteration. 

Definition 8.8. Let y = 'H{Z,y) be a well-founded system. The Newton operator for exponential 
generating series is defined by 

Nn{z, Y{z)) - Y{z) + (Id - dH/dY{z, Y{z)))-' ■ {H{z, Y{z)) - Y{z)) , (14) 

where H is the vector of exponential generating series of fi. 

The Newton operator for ordinary generating series is defined by 

^M^{z,Yiz)) Yiz) + (Id - ^e^^ey{z,Yiz)))-' ■ (*^(^,r(z)) - Y{z)) . (15) 

This last operator is one of the fundamental reasons why we resort to species theory. In the case of 
exponential generating series, Newton's iteration can be deduced from the equation Y{z) = H{z,Y{z)) 
over power series. In the case of ordinary generating series, the analogous equation is Y(z) = ^-^(Y (z)) , 
but Newton's iteration also uses ^a-H/oy that we recover from the combinatorial origin of the system. 

We now show that the iterations defined using these operators converge as expected. 

Definition 8.9. The convergence of a sequence (F^"'(2))„>o to a vector of series F{z) is quadratic when 
the distance is at least squared at each step. In other words, the number of matching coefficients doubles. 

Theorem 8.10. Let y = H[Z^y) he well founded and let S denote its solution. Newton's iterations 
defined hy 

yh+U (^) = (^,^ (^)) ^ y [n+i] (^) = (^,^ y N (^)) 

with Y^^\z) — 0, converge quadratically, respectively to S{z) and S{z). 

Proof. This is an application of Lemma 8.7 to the combinatorial Newton iteration of Theorem 6.3. □ 

Example I4. The ordinary and exponential generating series of Catalan trees satisfy T{z) = z/{l —T{z)). 
The corresponding Newton iteration is 

^[n+1] ^ rj.[n] , ZV^ > r„] ^ i 

l-z(l/M)2' 1-rN' 

with r[°l = 0. The first steps are: 

Tin =z + z^ + z' + z^ + z'' + z'' + z' + z' + z'' + z'° + -- - , 

tI^I = z + + 2z^ + 5z^ + 14z^ + 42z® + 131z^ + 417^** + 1341^" + 4334z^" + • • • , 
T[31 = z + z^ + 2z^ + 5z* + 14z^ + 42z^ + 132z'^ + 429z^ + 1430z*' + 4862z^° H . 
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Boldfaced terms are those matching with the solution. 

Example 15. The ordinary generating series G{z) of Cayley trees satisfies 



G{z) = z exp {g{z) + \g{z^) + • • • ^ 



The species of Cayley trees is defined hy Q = Z ■ Set(C/). The combinatorial Newton operator corre- 
sponding to 7i{G) = Z ■ Set(CJ) is therefore 

Nn{y) = y + seq{b) ■ {B ~ y) with b = z -SETiy). 

The associated Polya operator is given by 

: Yiz) ^ Y{z) + ^i^l ^1^)'^ with i?(z) = z exp + + ...). 

The first few steps give: 

Gin = Z + + Z3 + ^ ^5 + ^ ^ ^8 + ^9 + ;jlO + . . . ^ 

G^^l = z + z^ + 2z^ + 4z^ + 9z^ + 20z^ + 47z^ + llOz^ + 261z^ + 620z^" + • • • , 
G'^I z + z^ + 2z^ + 4z'* + 9z^ + 20z^ + 48z'^ + 115z^ + 286z'' + 719z^° + • • • . 



Computing all those series up to the desired order is actually unnecessary. It is possible to truncate 
the series at each step of the iteration. We use the notation f{z) mod z^ to represent the series f{z) 
truncated at its iVth coefficient. 

Proposition 8.11. Let y — H{Z,y) he a well-founded system. Newton's iterations defined by 

= N<H. mod 2^, = *v« (z,^^"^^)) mod z^ (16) 

with Y^^\z) = S{0) and N — 2"+^, converge quadratically, respectively to S{z) and S{z). 

Proof. This is an application of Lemma 8.7 to the combinatorial Newton iteration of Proposition 6.8. □ 

Example 16. The truncated iteration for Catalan trees becomes 

r^[n+i] ^ ^^'"' - ^'"^ ^od z^"^' , l^N = mod z2"+^ , 

i-z(fN)2 ' 1-rN 

with ^['^1 =0. The first few terms are: 

rw = z, 

r[2l = z + z^ + 2z3, 

r['''l ^ z + z^ + 2z^ + Sz-* + 14z^ + 42z'^ + 132z^ 

rW = z + z^ + 2z3 + 5z^ + 14z-'^ + 42z'^ + 132z^ + 429z*^ + 1430z^ + 4862z^° + 16796z" 
+ 58786z^2 + 208012z" + 742900zi'* + 2674440zi^ 

Even if it seems slower than the iteration of Example 14, only correct coefhcients are computed and the 
convergence is still quadratic. The main improvement is that the computations can be done using no 
more precision than what is needed, which leads to a faster algorithm. 
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Algorithm newtonSeries: Computation of generating series with a given precision 



Input: A type: EGS (exponential g.s.) or OGS (ordinary g.s.) 

Input: A vector of species 7i ~ {Hi-.m), such that y — 'H{Z,y) is weU founded 

Input: An integer N 

Output: The first N terms of the exponential (or ordinary) generating series S{z) of 
the solution oiy ^ n{z, y) 

begin 

Compute the Jacobian matrix ^{Z.y^ := d'H/dy{Z,y) 
if the type is EGS then 

Set up a procedure sH: {Y{z). N) n- H{z, Y{z)) mod z^ 

Set up a procedure sJ: {Y{z).N) ^ J{z,Y{z)) mod z^ 

II H and J are the e . g . s . of ft and ^ 

else (the type is OGSj 

Set up a procedure sH: {Y{z),N) i-> 4>-j^(z, l^(z)) mod z^ 
Set up a procedure S J: {Y{z), N) i-^ ^j-{z, Y{z)) mod z^ 

II and ^j- are the Polya operators of H. and 

U, Y:= recSeries (N) 

return Y 
end 

Function recSeries 
Input: An integer N 
Output: U: (Id - J(z, S'(z)))"^ mod z 
Output: 1": S{z) mod z^ 
begin 

if TV = 1 then return Y := H"\0, 0) and U := Id 
else 

U, Y := recSeries i\N/2']) 

U ■.= U + U ■ (s J(r, \N/2']) -U + Id-U) mod zT^f/al 
Y ■=Y + U- (sH(y, N) - Y) mod z^ 
return U, Y 

end 
end 



Optimized Nev^rton iteration The optimization of Newton's iteration described in section 6.3 for the 
computation of species can also be adapted to series: it computes in parallel the inverse of the Jacobian 
matrix and the iterates of the solution, so that it only needs one iteration for the matrix inversion at 
each iteration of the solution. 

Algorithm newtonSeries describes the computation of exponential (or ordinary) generating series at 
precision N by the optimized Newton iteration. Given a vector of species = (Hi-.m), such that the 
system y = 7i{Z, y) is well founded, together with an integer N, the algorithm computes S{z) mod z^ , 
where S{z) is the series solution of the system such that S'(O) = i?'"(0, 0). For this purpose, it also 
computes (Id — dH /dY{z, S{z)))~ mod ^T-'^/^T , the inverse of the Jacobian matrix, at precision \N/2~\ . 
This is done recursively, starting from N the desired number of terms. By Theorem 8.10, one Newton 
step from \N/2'] terms computes the result and, by the reasoning in the proof of Proposition 6.9, \N/2'] 
terms of the inverse of the Jacobian matrix are sufficient. The end of the recursion, when A'^ = 1, is 
obtained by the initial 5(0) = ?i'"(0, 0) and U~\0) = Id. 

The difference between the two types of generating series lies on the way to compute the series for "H 
and dH/dy. The computation of their exponential generating series is straightforward using rules such 
as those given in Table 3, while for ordinary generating series, the Polya operators are needed. Since the 
precision is given in input, these operators can be truncated in order to make the computation tractable. 
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In both cases, the inner recursive procedure is the same. 

Example 17. Here are the iterates computed by Algorithm newtonSeries to get the exponential and 
ordinary generating series of Cayley trees {y = Z ■ Set(3^)) with precision N = 10. 



Exponential generating series 


Ordinary generating series 


uw = 1 


urn = 1 

y[i] = z 


rrf2l ^ 1 , 
U ' = 1 + z 


U ^ ' = i + z 

= Z + z2 


= 1 + Z + 

y[3] _ ^ I 2 2 , 9 3 , 64 4 , 625 5 
1 ^ ^ -r '6 ^24 ^120 


1 + z + 2z2 

ypi = 1 + z + 2z2 


vf4l _ 1 2„2 1 9^3 1 64^4 1 625 „5 , 7776 ^6 , 117649 .,7 , 
1 — -4^2-^ T^6^ ^24^ T"120"^ 'T" 720'^ ~^ 5040 
2097152 ^8 1 43046721 ,9 i 1000000000 ,10 
40320 ' 362880 ^ ' 3628800 


t/W = 1 + z + 2z2 + 5z3 + ISz-* + 35z5 

y W = z + z2 + 2z3 + 4z4 + 9z^ + 20z6 + 
48z^ + 115z« + 286z9 + 719z^° 



8.3 Arithmetic Complexity of Enumeration 

We now turn to the complexity analysis of the computation of the generating series up to precision TV, or 
equivalently of the computation of enumeration sequences for structures up to size N. This means that 
we are computing with truncated power series of the form 

N 

fN{z) = Y.fnz''^f{z) mod z^+\ 

n=0 

We first deal with the arithmetic complexity (number of arithmetic operations), while the next section 
deals with the number of bit operations. 

We show that the arithmetic complexity of the computation of the generating series of the species 
solution of y = 7i{Z, y) with precision N can be expressed in terms of a arithmetic complexity of the 
species H. In the framework of constructible species, this complexity turns out to be quasi-optimal in N . 

Definition 8.12. A multisort species 71(2, y) is of exponential arithmetic complexity Ce (resp. ordi- 
nary arithmetic complexity Co) when, for any species Vl{Z), it is possible to compute the exponential 
(resp. ordinary) generating series of 7i{Z ,Vl{Z)) with precision N from the exponential (resp. ordinary) 
generating series of U{Z) in Ce{N) (resp. Co{N)) arithmetic operations. 

When the type of series has no influence on the complexity result, we omit the subscript, and denote 
the arithmetic complexity by C instead of C or Co . 

Lemma 8.13. Let !F and Q be species with respective arithmetic complexity Ci and C2, then the com- 
position !p oQ has arithmetic complexity Ci + C2. 

Proof. For any species W, the computation of the generating series of Q(]Ll) with precision N has arith- 
metic complexity C2{N), and then then computation of the generating series of ^{QiU)) with precision 
N requires Ci{N) more arithmetic operations. □ 

An important illustration comes from constructible species. 

Proposition 8.14. Iterative unisort constructible species have arithmetic complexity in 0(M), both in 
the ordinary and exponential frameworks. So have their derivatives. 

Here, we use the classical notation M to denote a multiplication function: M{N) is an upper bound on 
the number of arithmetic operations needed in the product of two polynomials of degree at most N. In 
particular M{N) — 0{N log N) with algorithms based on the fast Fourier transform. However it is more 
convenient to state the results in terms of M(A^); replacing this function by the arithmetic complexity of 
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the underlying multiplication in an actual implementation gives a more accurate estimate. We use the 
usual conventions in this context: M(7Vi + A^2) < M(A^i) + M(7V2), and TV log TV = 0{M{N)), see [12] for 
more information. 

Proof. We are interested in constructible species obtained by composition of the basic operators presented 
in Table 3. We first state the arithmetic complexity for these basic operators. 

For exponential generating series, the Newton iteration method allows for computing rapidly on power 
series: calculating the reciprocal of a power series, or its logarithm, power and exponential up to can 
be achieved with arithmetic complexity 0{M{N)). These results are classical [12]; we present explicit 
algorithms in Section 10. By the previous lemma, the arithmetic complexity of the composition of two 
such operators is also in 0{M{N)). 

Ordinary generating series are expressed using Polya operators. Those in Table 3 can be expressed in 
terms of a power series of the form 

k>0 

(taking log(l/(l — G(z))) for G{z) in the case of cycles). The computation of G{z^) with precision N 
only uses G{z) with precision \_N /k\ and no arithmetic operation, so that the whole sum requires at most 

N/k ~ A^log arithmetic operations, which is again in 0{M{N)). The final exponential for sets has 
arithmetic complexity 0{M{N)) too. 

The constructions with a cardinality constraint depending on an integer £ lead to polynomials in 
G{z), G{z'^), . . . , G{z^), whose expansion at precision N are thus also of arithmetic complexity 0{M{N)), 
the implied constant in the 0() term depending on the actual polynomial. 

By Table 1, all derivatives of constructible species are constructible, whence the last part of the 
result. □ 

We now compute the arithmetic complexity of implicitly defined species. 

Theorem 8.15. Let y = 'H.{Z,y) he well- founded and assume that H and dH/dy have arithmetic 
complexity G . Then the species S solution of the system has arithmetic complexity 0(C + M). 

The following consequence is now immediate from Proposition 8.14. 

Corollary 8.16. Constructible species have arithmetic complexity 0(M), both in the ordinary and ex- 
ponential frameworks. 

Proof of theorem 8.15 We first deal with the computation of the truncated generating series of the 
species S itself. Newton's iteration on combinatorial systems is a "divide and conquer" algorithm that 
computes generating series up to order N . Denoting by T{N) the arithmetic complexity of Newton's 
iterations from Eq. (16) for computing the first N — 2" terms of the solution series of ^ = H-iZ, y), we 
have 

T{N) = T{N/2) + 2C{N) + R{N) + KM{N) + 0{N), (17) 

where R{N) is the arithmetic complexity of computing the inverse of the matrix at precision N and 
K counts the number of products of power series involved in the product of this inverse by the last 
vector. Finally, series vector addition and subtraction at precision A'' require 0{N) arithmetic operations. 
The term R{N) can itself be replaced by 0{M{N)), the inverse of a matrix of power series being itself 
computed by Newton's iteration (see §6.2). With the hypothesis that NlogN — 0{M{N)), the arithmetic 
complexity of expanding the generating series of S to the order N is thus 0{C{N) + M(A^)). 

For a species U of arithmetic complexity C, the species S{U{Z)) is solution to the system y = 
■H{Z,y), with iiiZ^y) = n{U{Z),y)). The hypothesis on n implies that n and d'H/dy{Z,y) = 
dH/ dy{U{Z),y) both have arithmetic complexity C + C*. Thus by the previous argument, the solution 
to this system can be computed within the desired complexity, which concludes the proof of the theorem. 

□ 
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Optimized Newton iteration All the steps of the reasoning apply to the optimized iteration used in 
Algorithm newtonScries: 

1. Truncation of species (the analogue of Corollary 6.8), by truncating W^"^^' at size 2" and ^["+^1 
at size 2"+i; 

2. Translation into exponential and ordinary generating series (analogues of Theorem 8.10 and its 
truncated variant Proposition 8.11); 

3. Arithmetic complexity estimate for implicit species: in the proof of Theorem 8.15, the cost R{N) of 
computing the inverse of the matrix in Equation (17) is replaced by the smaller cost of one matrix 
product, which has an impact on the constant hidden in the 0{) estimate of that theorem. 

8.4 Bit Complexity of Enumeration 

In the preceding section, we only computed the number of arithmetic operations. While this leads to 
complexity estimates that measure correctly the time needed by the computations when the coefficients 
are e.g., floating point numbers, this measure is less pertinent when dealing with exact integer or rational 
coefficients, whose size grows with the precision of the series. We now estimate the bit complexity 
of Newton's iteration on power series taking into account the cost of the operations on the integer or 
rational coefhcients. This complexity is expressed using a function Mz(iV), which represents an upper 
bound on the number of binary operations for multiplying two integers of size at most N bits. Using the 
fast Fourier transform one has Mz(iV) — 0{N log NloglogN) but expressing the complexity in terms of 
Mz{N) allows for a better understanding of the actual time needed by an implementation based on a given 
arithmetic library. As we did before with the function M, we use the usual assumption Mz(iVi + N2) < 
Mz{Ni) + Mz{N2) and refer to [12] for more information. 

8.4.1 Ordinary Generating Series 

Lemma 8.17. The product of analytic ordinary generating series at precision N has bit complexity 
0{Mz{N) X M{N)). 

Proof. This is a consequence of the exponential growth formula for coefficients of a power series F{z) 
with radius of convergence p > 0: limsup([z^]i^(z))^/^ = 1/p. Since the coefficients are integers, their 
numbers of bits grow at most like N log2 1 /p, so that all the coefficients up to the iVth one have size 
bounded by KN for some K > 0. The computation of the product then requires 0{M{N)) operations, 
each of bit complexity bounded by 0{Mz{KN)) — 0{Mz{N)), whence the result. □ 

Analytic series with integer coefficients have radius of convergence at most 1. When this radius is 
smaller than 1, the bit size of the truncated power series is quadratic in N, while the above complexity 
estimate is 0{N^ log^ iVloglogiV) if fast Fourier transform is used. Thus the bit complexity is linear in 
the size of the input and output, up to logarithmic factors. 

Proposition 8.18. Let y — H{Z^y) he well-founded and assume that T-L and dH/dy have ordinary 
arithmetic complexity Co and that the ordinary generating series S of the solution of the system is analytic 
at 0. Then the computation of S at precision N has bit complexity 0{Mz{N) x {C{N) + M(A^))). 

Proof. In Newton's iteration, all operations at precision N add an extra factor in 0{Mz{N)), so that the 
recurrence relation (17) for bit complexity now turns into 

B{N) = B{N/2) + Mz(iV) (2a(iV) + R{N) + KMiN) + 0{N)) , 

whose solution is bounded by 0(Mz(iV)(Co(A^) + M(7V))). □ 

Corollary 8.19. The computation of the ordinary generating series of constructihle species with preci- 
sion N has bit complexity 0{U{N) x Mz(iV)). 

Proof. The bound Co{N) = 0{M{N)) is given by Proposition 8.14. The analyticity of the solution is 
proved in Theorem 9.9 below. □ 

As above, when the radius of convergence is not equal to 1, this complexity is quasi-optimal: it is 
linear in the size of the output, up to logarithmic factors. 
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8.4.2 Exponential Generating Series 

Exponential generating series have rational coefficients and a bit of care is needed in order to multiply 
them efficiently. Still, we obtain a quasi-optimal method. 

Lemma 8.20. The product of analytic exponential generating series at precision N has bit complexity 
0(M(iV) X Mz(^logiV)). 

Proof. When the radius of convergence of an exponential generating series f{z) — X]ra>o fn^"' /n\ is finite 
and nonzero, the coefficient /„ has bit size bounded by 0(n log n), thus the bit size of the coefficients in 
the truncated series /Ar(z) = J^o InZ^/nl is in 0{NlogN). When the radius of convergence is infinite, 
fn/nl tends to faster than nlogp for any p, thus the coefficients in /Ar(z) are still in O(A^logiV). 

In order to exploit the integrality of the coefficients /„ in fN{z), we change the representation, and 
consider the truncated series 

N 

Fn{z) = J2 ^!/"^"/"! = N\fN{z), 

in which the bit size of the coefficients is now bounded by 0(A^log A^). The product of series is computed 
by 

iFG)N{z) = l^FNiz)GN{z). 

This transformation adds an extra term in 0{NMz,{N log N)) in the bit complexity of the product, since 
each of the N terms must be divided by A^!; this extra term is absorbed by the cost of the product of the 
series Fn{z) and GAr(z), which is in 0(M(iV)Mz(iV log TV)). □ 

Proposition 8.21. Let y — H{Z,y) be a well-founded system and assume that H and dH/dy have 
exponential arithmetic complexity Cg (N) and that the exponential generating series S of the solution of 
the system is analytic at 0. Then the computation of the series S at precision N has bit complexity 
0{Mz{NlogN) X (CeiN) + M(7V))). 

Proof. Similar to that of Theorem 8.18. □ 

Corollary 8.22. The computation of the exponential generating series of constructive species with pre- 
cision N has bit complexity 0{U{N) x Mz(iVlogiV)). 

Proof. Similar to that of Corollary 8.19. □ 

For the optimized Newton iteration, the bit complexity estimate follows the same lines, and, as in the 
case of arithmetic complexity, the constant in the 0() estimate is smaller. 



9 Analytic Species 

Random generation by Boltzmann sampling [8, 9] depends on so-called oracles giving numerical values 
of generating series inside their disk of convergence. In this section, we transfer the results of the 
previous one to provide numerical Newton iterations that converge to these values. Classically, sufficient 
conditions for the convergence of Newton's iteration include a starting point close enough to the root. 
In this combinatorial context however, our iteration manages to capture the combinatorial origin of the 
equations and converges unconditionally when started at the origin. 



9.1 Basic Properties 

We depart slightly from the general framework of species theory to concentrate on cases when the series 
converge in a neighborhood of 0. This is motivated by Theorem 9.9 below showing that all generating 
series coming from implicit constructible species have a nonzero radius of convergence. 

Definition 9.1. A species H{Z) is called analytic if its exponential generating series H{z) is analytic 
in the neighborhood of 0. 
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A subspecies of an analytic species is itself analytic, by absolute convergence. Also, if a species y) 
is analytic, its Jacobian matrix is analytic too. 

Lemma 9.2. Iterative constructihle species are analytic. 

Proof. This follows from the analyticity of the generating series in Column 5 of Table 3, the analyticity 
of the composition of analytic series at and that of polynomials with analytic series. □ 

Proposition 9.3 (Implicit analytic species). Let y ~ H{Z,y) he a well-founded system, and S its 
solution. If the species 'H.{Z,'U.) := 71(2, S{0) + is analytic, then S is an analytic species. 

Note that when the system is well founded at 0, the condition simplifies to H{Z,y) being analytic. 

Proof. First we observe that the species ^{Z,U) is well defined. Let Si{Zi,Z) be defined as in The- 
orem 5.7. This species is polynomial in Zi, so that Prop. 4.5 implies that for all i — 1, . . . ,m (m the 
number of coordinates of either the ith coordinate of <Si(Zi, 0) = <S(0) is or 7i{2,y) is polyno- 
mial in By Lemma 4.6, this in turns implies that ^^(.2,5(0) + U) is polynomial in Zi, so that its 
composition with Zi = 1 is defined. 

Next, the proof is a simple consequence of the implicit function theorem for analytic functions (see 
e.g., [6, Ch. IV]). The necessary conditions are fulfilled: by hypothesis H{z,u) is analytic and so is its 
Jacobian, moreover the matrix (Id— 9i?/c?M)(0, 0) is invertible, by the nilpotence oi d'H/ dy{Q,Si{l,0)), 
itself a consequence of Proposition 4.5. □ 

9.2 Dominant Species and their Generating Series 

The algorithms introduced in later sections use bounds on series associated to species. In order to define 
relevant bounds for implicit subspecies, we introduce the notion of dominant species that is consistent 
with well-founded systems. The domination of species translates into majorant series, that play an 
important role in the design of our numerical oracle in Section 9.4. 

Definition 9.4. For any formal power series F and G with nonnegative coefficients, we say that G is a 
majorant series for F and write F < G if for all n > 0, their coefficients satisfy [2;"']i^(2;) < [z'^]G{z). 
The notation F <i G for vectors or matrices means that the property holds entry by entry. 

Definition 9.5. A multisort species T{Z,y^, is dominated by the species Q(Z,y') if 

1. g is flat (see §7.2); 

2. the ordinary generating series obey F <\G; 

3. for any (n, fc) and any coordinate i, [z^y'']Fi = [z"-y^]Gi — 0. 

This is denoted by T{Z, y) <\ g{Z, y). 

The last condition ensures that dominant species retain some of the characteristics of those they 
dominate. 

Example 18. Sets are dominated by sequences: sequences are flat and both ordinary generating series 
are equal (see Table 3). 

Example 19. Cycles are dominated by nonempty sequences: Table 3 gives the ordinary generating series 
of cycles as ^ (/)(fc)/fclog(l/(l — z'^)), but this rewrites &s z/{\ — z) so that again the ordinary generating 
series are identical. 

While the definition of dominance is in terms of ordinary generating series, the exponential generating 
series also follow the same inequality: 

Lemma 9.6. Let and Q he two multisort species such that Q is a dominant species for T , then G{z) 
is a majorant series for F{z). 
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Proof. This is the unisort case, which extends to multisort species. 

Let /„ be the number of labeled J^-structures on {1, . . . ,n} and /„ the number of unlabeled such 
structures, and define similarly gn and g„ for Q. By dominance, these are related by /„ < g„. The 
number of labeled structures /„ is bounded by n!/„, while flatness of Q implies gn — nlgn- Thus the 
proof is summarized by 

fn < nlfn < nlgn = gn- 

□ 

Dominance passes through systems of equations. 

Proposition 9.7 (Implicit Dominant Species). If the species ^{2,y) is dominated by Q{2,y) and the 
system y = ^{2, y) is well founded, thenV = Q{Z ^V) is well founded and the solution of y = ^ {Z ^y) 
is dominated by the solution of V — Q{Z,'V). 

Example 20. By example 18, Set is dominated by Seq, thus the species Q of Cayley trees defined by 
Q = Z ■ Set(5) is dominated by the species of Catalan trees defined by T = 2 • Seq(T). This transfers 
to both their exponential and ordinary generating series: 

^2 

T{z) = z + 2— + 12— + 120— H is a majorant series for G{z) = z + 2— + 9— + 64— H and 

2. 3. 4. 2. 3. 4. 

f{z) = z + z'^ + 2z^ + hz^ + 14z^ H is a majorant series for G{z) ^ z + z^ + 2z^ + Az^ + 9z^ ^ . 

The proof relies on the preservation of dominance by composition. 

Lemma 9.8. Let !F , Q , A. and 3 be multisort species such that Q and 3 are flat. If ^[Z, y ) is dominated 
by Q{Z, y), A. is dominated by 3 and the composition JF(.Z, A) is defined, then the composition Q{Z, 3) 
is defined and ^{Z, A.) is dominated by Q{Z, 3). 

Proof. Recall that the composition ^{Z,A) is defined when is polynomial with respect to the coor- 
dinates for which ^(0) is not 0. By the last part of the definition of dominant species, those are exactly 
the coordinates for which 3{0) is not and then Q is polynomial with respect to them too. 

Next, we observe that as a composition of flat species, Q{Z,3) is flat too (by Lemma 7.3). The 
condition on ordinary generating series is given by the following chain of equalities and inequalities in 
the unisort case: 

Zr{A[z), A{z^), . . . ) < Zr{B{z),B{z^), ...) 

<^Zr{B{z),B{z)\...)^F{B(z)) 
<^G(B{z)) = Zg{B{z),B[z^),...). 

The first inequality comes from the domination of ,4 by S and the positivity of the coefficients of Zjr] 
the second one comes from ordinary generating series having nonnegative integer coefficients; the third 
one is a consequence of the domination of T by Q. The same reasoning applies to the multisort case. 
The last property follows from Corollary 3.3. □ 

Proof of Proposition 9. 7. We first deal with the case when .^(0, 0) = 0, which is also the value of ^(0, 0) 
by domination. Since dT jdy is dominated by dQ/dy, so are their values at 0, and the nilpotence 
of dQ jdy at follows from Lemma 9.8 with T = y™, where to is the dimension of the system T . 
Thus both sequences (>'["])„>o and (V["l)„>o defined by = :F(S,3;["1) and Vt"+il = g(S, V^"!) 

converge. By induction using Lemma 9.8 again, for all n > 0, y'"' is dominated by V^"'. The property 
on limits follows from considering any fixed size. 

If JF(0, 0) 7^ then we first consider the companion system for dominated by the companion system 
for Q. These systems are well founded at and thus by the previous argument, the solution Sq{Zi) of the 
first one is dominated by the solution 7~o(-2i) of the second one. In particular, «So being polynomial implies 
that 7~o is polynomial too, and the nilpotence of dQ j dy [fi q{Z\)) follows again from Lemma 9.8. The 
last condition showing that V = ^(^, V) is well founded is immediate as well. The domination of the 
solutions follows from the same argument as above. □ 
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9.3 Constructible Species are Analytic 

Theorem 9.9. If y — H{Z,y) is well founded, where H is a constructible species, then it defines a 
species whose exponential and ordinary generating series are analytic in the neighborhood of the origin. 

The first step of the proof is to find good dominant species. 

Lemma 9.10. Any constructible species is dominated by aflat constructible species. 

Proof. The proof is by induction on the definition of the constructible species. First, all the basic species 
are either flat {1,Z,+,-, Seq and the J^i), or dominated by flat constructible ones: Set is dominated 
by Seq (Example 18) and Cyc is dominated by Seq>o (Example 19). Any basic species J" with a 
cardinality constraint is a subspecies of and flatness is preserved by inclusion. Composition preserves 
flatness by Lemma 7.3. Finally, implicit species are obtained by Proposition 9.7. □ 

Lemma 9.11. Flat constructible species are analytic. 

These species correspond to context-free languages, so that this lemma is the classical fact that 
algebraic generating series are analytic. 

Proof. Flat constructible species are obtained by removing Set and Cyc from the basic species used in 
Deflnition 7.1. The iterative constructible species are thus clearly analytic. Adding a new variable y to 
the system for each Seq{U), and the corresponding equation y = I + yU, shows that a well-founded 
system of flat constructible species can be rewritten as a well-founded system with polynomial H. Thus 
the corresponding H in Prop. 9.3 is analytic, so that the conclusion of the Proposition holds and the 
recursive constructible flat species are analytic as well. □ 

Theorem 9.9 is now a consequence of these two lemmas, the definition of dominant species for the 
ordinary case, and Lemma 9.6 for the exponential case. 

9.4 Numerical Evaluation 

A simple way to compute numerical values of the generating series inside their disk of convergence is to 
first compute sufficiently many terms of the power series (e.g., by Newton's iteration, using 2" terms at 
the nth iteration, following Theorem 8.10) and then evaluate the series numerically. While this method 
is quite efficient close to the origin, it might require a large number of coefficients for values closer to the 
circle of convergence of the series. We now consider faster ways, first for exponential generating series, 
then in the case of ordinary generating series. The latter is more involved, except of course for flat species. 

9.4.1 Exponential Generating Series 

A consequence of the nice behavior of exponential generating series under composition is that Newton's 
iteration can be used numerically in a straightforward way. 

Lemma 9.12 (Transfer, numerical part, exponential generating series). Let y = 'H{Z,y) be a well- 
founded system. Let also ^ be an analytic species such that 

y[n+i] ^ :F(z, >;["!), with = o, (i8) 

defines an increasing sequence of species converging to the solution S of the system. Then the exponential 
generating series S{z) of S has positive radius of convergence p and for all a such that \a\ < p, the 
sequence 

y[n+i] ^ F{a,y^''^), with = 0, (19) 

converges to S{a). 
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Proof. The species S is analytic by proposition 9.3. The point is to show that for all a such that 
< |a| < p, Y^'^\a) converges to S{a), is well defined and y["l = ^["'(a) (the evaluation of F'"' at 
a is equal to the value obtained by numerical iteration). 

By Lemma 9.17 below, the monotonicity and convergence of the combinatorial sequence [V'"' imply 
that the y'"' 's are analytic for \z\ < p, and that 1^'"' (a) converges to S{a). Let r be such that |q;| < r < p. 
Assuming F{z,S) to be analytic in a polydisk |(2,S)| < {r,S{r)) with component-wise inequality, the 
vector F{a,Y^^\a)) is well defined, and thus by induction 

y[n+i] = F(a,y["l) ^ F(a, = Y^''+^\a). 

We now prove the required analyticity of F{z, S). Let F{z, S) = J2 f i,j^^^i^ ' ' ' ^nT ^i^*^ ^i^) = E CkZ^ . 
For each coordinate h £ {1,...,to}, extracting the coefficient of z*^ [k — Q,...,N) in the identity 
F{z, S{z)) = S{z) leads to an inequality of the form 

J2 fh,^,jr\J2 ^hkr^'Y' • • • ( £ c„,fcAO''" = "hM^" < Shir), iV G N, 

i+ji^iH \-jTaim<N fci=0 fcm=0 k<N 

where first indices denote coordinates. The coefficients being positive, the first sum converges to Sh{r) 
as N ^ oo. This proves the convergence of Fh{z, S) for \{z, S)\ < (r, S{r)) and therefore that of F{z, S) 
which concludes the proof. □ 

A first consequence of this lemma is that when H is analytic, the iteration (19) with F = H computes 
values of S. More interesting is its use with the Newton operator for ^. 

Theorem 9.13 (Newton oracle for values of exponential generating series). Let y = H{Z,y) he a 

well-founded system with H an analytic species. Let a he inside the disk of convergence of the expo- 
nential generating series S{z) of the solution species S. Then the following iteration converges to the 
solution S{a) of the system: 

Proof. This is a consequence of the transfer lemma, since the Newton operator is an analytic species. □ 

Example 21. The exponential generating series of Cayley trees satisfies G{z) — zexp(G(z)) (see Ex. 13). 
Its value at a is given by the limit of the simple Newton iteration: 

^[n+l] ^ g[n] ^ "fig"" - gN 



1 - aes'"' 

with initial value g'"' = 0. For a = 1/10, the first few values of the series of Cayley trees are: 

0.11111111111111111111, 
0.11183252640942066782, 
0.11183255915896289731, 
0.11183255915896296483. 

Boldfaced digits indicate those that match the digits of the actual value. 
9.4.2 Ordinary Generating Series 

By Theorem 9.9, the ordinary generating series S{z) of a species «S, solution of the well-founded sys- 
tem y = Hi^Z, y), with a constructible H, is analytic in the neighborhood of the origin. As above, while 
evaluating S{q.) for a inside the disk of convergence of S{z) can be achieved through numerical evalua- 
tion of power series obtained by Newton's iteration, this requires the computation of a large number of 
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coefficients and a more direct numerical algorithm is preferable. If H is flat, then the technique of the 
previous section applies. 

Otherwise, we use a semi-numerical algorithm combining two techniques: computation of generating 
series truncated at a small order that can be evaluated at small enough values and iterative evaluation 
at powers of the point of interest. 

First, we observe that Polya operators act naturally on sequences: if a lies inside the disk of conver- 
gence of the ordinary generating series H[z) := ^jr(G{z)), then by Prop. 8.4 and 8.5, the sequence 
{H {a'^)) keN* can be computed from the sequence {G{a''))keN* ■ Associated to the Polya operator 
: G{z) ^-> H{z), we use the sequence transformer 



which computes the sequence H{a), H{a'^), H{a^), . . .from a and G{a), G(a^), G{a^), . . . 

We now give an analogue of Lemma 9.12 transferring combinatorial convergence into numerical con- 
vergence of sequences. 

Lemma 9.14 (Transfer, numerical part, ordinary generating series). Let y = 7i{Z, y) be a well-founded 
system. Let also ^ he an analytic species such that 



:p(z, withy^^^^Q 



defines an increasing sequence of species converging to the solution S of the system. Assume that the 
ordinary generating series S of the species S has positive radius of convergence p. For all a such that 
\a\ < p, the sequence of sequences 

(yi"+")feeN. = *^(a,(yi"l)feeN*) , with {y^°^)keN* = (0,0,...), 

converges to the sequence {S{a''))kefi* , in the sense that maxfc ||.^(a'^) — — )• as n ^ oo. 

This lemma applies in particular to a constructible species H] the convergence of S{z) in a neighbor- 
hood of the origin is then granted by Theorem 9.9. 

_ [n] - [n] 

Proof. The convergence of the series Y (z) in |z| < p, as well as the convergence of the sequence Y {a) 
to S{a) follow from the same argument as in Lemma 9.12. 

- [n] 

We have to show that for all a such that |a| < p, the sequence ^jr{a, {Y (a''))fcGN*) is well defined, 

for then by induction (yfc'^^')fceN* — {Y^ ^ \a^))k<£n* . As in the case of exponential generating series, 
this is obtained by a positivity argument. Indeed, the cycle index series of from Eq. (12) has nonnegative 

~ [n] 

coefficients, so that the evaluation of ^jr{z^Y (z)) is bounded termwise by the convergent evaluation 
of ^jr{z, S{z)) — S{z), which shows that the iteration is well defined. □ 

Theorem 9.15 (Newton oracle for values of ordinary generating series). Let y — H{Z,y) be a well- 
founded system with H a constructible species. Let a be inside the disk of convergence of the ordinary 
generating series S(z) of the solution. The following iteration converges to the sequence {S{a'^))ket>]* ■' 

{y^t'^)ken^ = ^^r■u («,(yL"')feeN*) , {yf)km^ = (0,0,...), 
where Affi is defined by Equation (7). 

Example 22. For flat species, the iteration is the same as in the previous section. For instance, the species 
of Catalan trees satisfies T = ZSeq(T). The combinatorial Newton operator is given in Example 9. The 
corresponding Polya operator is 

Yiz)^Y{z)+ '^^'^-/l;\ with Viz) = -^ 

1 — zV[zY 1 — r (z) 



44 



The associated sequence transformer is thus simply 



, , . ^ I . a'^Vk -Uk\ 1 
[a,(ukjkeN*)^ [uk + ' ■^itli 



and thus the value of T{a) is given by the same iteration as in the labeled case: 



l-a(wN)2' l-yN' 
with = 0. For a = 1/10, the first few values of the series of Catalan trees are: 

0.111111111111111111111, 
0.112701252236135957066, 
0.112701665379230322595, 
0.112701665379258311482. 



Example 23. The ordinary generating series G of Cayley trees satisfies 

G{z) = zcxp(G(z) + ^G{z^) + ---) = z + z^ + 2z'^ + 4z^ + 9z^ + -- - . 
The Polya operator for its Newton iterator was given in Example 15 as 

$Ar„ : Yiz) ^ Yiz) + ^j^l ^^^^^ with B{z) = zeMYiz) + ^Y{z^) + ■ ■ ■). 

This translates directly into a Newton iteration on sequences converging to values of G at powers of a 
by the corollary above. In the table below a — 0.3, and we show the evaluation of the first three values 
of the sequence {Y^"\a''))keN* , up to the fifth iteration. 



n 


r ["1(0.3) 


rW(o.32) 


y["i(o.3^) 














1 


0.42857142857142857 


O.O98901098901098901 


O.O27749229188078108 


2 


0.54831147767352699 


0.099887063059789885 


0.027770629177403332 


3 


0. 55709091792164806 


0.099887162357063362 


0.027770629192262428 


4 


0.55713917646743778 


0.099887162357064255 


0.027770629192262428 


5 


0.55713917793231456 


0.099887162357064255 


0.027770629192262428 



The rest of this section describes ways to compute this iteration in practice. 

Hybrid Method We now have two convergent iterations at our disposal: one on truncated power series 
and one on infinite sequences of values at powers of a. Our method below consists in combining these 
iterations in parallel so as to get rid of infinite sequences, using the iteration of Theorem 9.15 with power 
series to evaluate values at high exponents of a*, where they converge fast. It depends on a threshold K 
to switch the use of power series. This is illustrated in Figure 15. 

The method applies to a species with Polya operator and associated sequence transformer 'ifyr. 
The ordinary generating series F{z) has radius of convergence p, and the numerical evaluation con- 
cerns a < p. The input of the method consists of 

i. ai^-tuple (y["l,...,y^l) of approximations of (F^"! (a), l^I"! (a^)); 

ii. a truncation t{^'(z) := Y^^^\z) mod z™ of the Taylor series of Y"'"' at order m (which is used to 
evaluate values of (y|;"') for indices k > K); 

ill. a truncation order M on series; 
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Figure 15: Hybrid method: inside the gray disk, the evahiation uses a truncated power series 



iv. a precision e > 0. 
The idea is to compute 



[Uk JkeN* 



(a, . . . , y^l,TN(a^+i),TN(a^+2), . . . )) 



In practice, we cannot apply ^A/'>i to an infinite sequence, thus we need to determine the number L 
of nonzero terms that are necessary to compute the sequence (yj,"^^') at precision e. The output of 

the method is the vector (y^^^^^), and the truncated series Y^"'^^\z) mod z*^. When using a Polya 
operator given by Newton's iteration, this method is an algorithm if we use m = 2" and M = 2"+^ by 
Proposition 8.11. These bounds and the choice of K and L are discussed below. 

Method: Numerical evaluation of ordinary generating series. 
Input: T^J^X^) — Y^''\z) mod z™; M e N; e > 

Output: an approximation of (y^^^^^)', l^'"^^'(z) mod z'^ . 

1. Compute a bound L such that 



(a, )fceN* )) - (a, (y^"' , • ■ ■ , y^"' , 0, 0, 



< e; 



2. Compute {yi^x ) ^he first K values of the sequence 

*^ (a, (y["l , . . . , , tN (a^'+i), . . . , (a^), 0, 0, . . . )) ; 

3. Compute := 4':f(1"'''' (^) mod z™) mod z*^; 

4. Return y["+il(z) mod z^^ and (y^?^^'). 

Numerical Evaluation of Polya operators The first step of this hybrid method is to find a bound 
for the truncation of the Polya operators. We now turn to the computation of such a bound. We deal 
with Sets and Cycles. Other cases can be treated in a similar way. 

Lemma 9.16. Let y be an analytic species such that y{0) — 0. Let < a < 1 be inside the disk of 
convergence of the ordinary generating series Y of y . Let S{z) (resp. C{z)) be the ordinary generating 
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series of Set (y) (resp. CYC{y)). Then S{z) converges at a and for any L > , the following inequalities 
hold 

sl < o (a) < sl exp — > ^ = exp > — ^ — • 

\ " i>-L * / \i=i * / 

// moreover Y{a) < 1, i/ien C(z) converges at a and for any L > 

CL < C a <CL + with CL=} — log ^— . 

The argument of the exponential in the right-hand side of the first inequality tends to as L tends 
to infinity, so that these inequalities can be used to compute S{a) and C(a) with arbitrary precision, 
provided one can compute values of Y at the powers of a. 

Proof. Table 3 gives 



logiSia)/sL) - J2 



i>L 



Since 3^(0) — 0, the generating series Y{z) satisfies Y{0) = and therefore Y{z)/z itself is a power 
series with positive coefficients. It follows that for any /3 such that < f3 < a^, Y{/3)/f3 < S, with 
S := Y{a^) /a'" . Using this inequality for ^ = a% i = L, L + 1, . . . gives the result for S{a). 
In the case of Cyc, the same reasoning leads to the sequence of inequalities 



< C(a) — cl = > log = < > log ^ . 




where we have used the classical identity J2i\7i = n 
Example 2^. In order to compute the value of 

~S{z)=eMY(z) + \Y{z^) + ---) 

at a = .3 when Y{z) = z + z'^ , we compute the first few values of 



exp 



i<L / 



which gives 

0.59, 0.064, 0.012, 0.0027, 0.00065, 0.00016, 0.000042, 0.000011, 0.0000030, 0.00000081 

showing that an error smaller than 10~^ is achieved as soon as L = 10. By monotonicity, this bound is 
also sufficient for the evaluation at the smaller a', j > 1. 

This is used to compute the numerical iteration for Cayley trees; starting from the row n = 2 in 
Example 23, where the truncation of Y^'^\z) is 2: + z^, the hybrid method then proceeds as follows: the 
values of 2 + 2;^ at 0.3* for i = 4, . . . , 10 are first computed and appended to the estimates of F[^](0.3'), 
i = 1, . . . , 3, which leads to the 10-tuple of values 

c = (0.5483115, 0.0998871, 0.0277706, 0.008165, 0.0024359, . . . , 0.0000059). 
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These values are then used to compute the values of (0.3, c, 0, 0, . . . )) at the second step of the hybrid 
method. In particular, the necessary values of -B(a') are obtained by 



B{a) 


~ a exp(ci + 


C2/2+. 


••+C10/IO) 




~ exp(c2 - 


h C4/2 + 


■■ - + 210/5) 


B{a') 


~ exp(c3 - 


h ce/2 + 


C9/3) 




~ a exp(c4 - 


hC8/2) 




B{a') 


~ exp(c5 - 


hcio/2) 






~ a* exp(ci), 


i = 6, 


...,10. 



Truncation orders In order to compute values of Y^"''{z), we use a truncation of this power series. 
Although the order 2" is valid in a Newton iteration for Y^"\z), it is desirable for efficiency reasons to 
use fewer terms if possible. We now discuss the choice of the order of truncation in terms of the desired 
accuracy. 

This is achieved using dominant species. If ?i is a flat constructible species dominating ft, and 14 
is defined by W = ?i(Z,W), then lA is flat and values of its generating series can be computed by 
the iteration for exponential generating series. This value is then used to bound truncation orders for 
subspecies of S thanks to the following result. 

Lemma 9.17. Let U{z) = uq + Uiz + • • • and 'V{z) = ■Uq + Viz + ■ ■ ■ he the generating series of two 
species U and V, such that V <iVi. Assume that the series U converges at r > 0. Then for any a 
with \a\ < r, 

\\U{r) - {uo + uir H h Mjvr-")|| < e ^ \\V{a) -{vo + Via^ h ■UAra^)|| < e. 

Proof. The coefficients of the species and its subspecies are related by < t>„ < m„. Therefore, 

II E ^ II E ^"'^"ii ^ II E ""''"II ° 

n>N n>N n>N 

This technique yields the following truncation algorithm. 
Algorithm: Truncation order 

Input: H, p, e, with p > inside the disk of convergence of U 

Output: A bound on the truncation orders for generating series of subspecies of S for |a| < p 

1. Compute R U{p) by Theorem 9.13. 

2. i := 0; 

3. Repeat: 

i i + 1; Compute [z^]U by Theorem 8.10; 
R:^R-[z^]U\p\^; 

4. Until ||i2|| < e 

5. Return i. 

Example 25. By Example 20, the species of Cayley trees (nonordered trees) is dominated by the species 
of Catalan trees. For p = 1/10, Example 22 gives U{p) ~ 0.112701665379258311482, while Example 14 
gives the first terms of the series, showing that 9 terms are sufficient to guarantee a precision e = 10^^ 
for the computation, since 

U{p) -{p + p^ + 2p3 + 5p4 14^5 _|_ 42^6 _^ ^^32^7 _^ 439^8 _^ 1430^0) ^ o.74 • 10"^ 
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It follows that the computation of C at precision e at any a < 1/10 can be performed using M — 10 
(9 terms) in the hybrid method. 

If Newton's iteration is used, the computation of [z^]U computes several coefficients at once. Obvi- 
ously, they are all used in the next step to improve the precision of i? = U{p) — {Uq + • • ■ + [z'^]Up^). 
The termination of this algorithm follows from the convergence of the series U at p which implies that 
as i — > oo. 

If N is the bound computed by this algorithm, our hybrid method can be used with k chosen in such 
a way that < p and M = min(2m, A^). By Lemma 9.17, all the evaluations of the series yf"l(z) 

at a' with i > k then have an error bounded by e. 

Example 26. To compute the numerical values of the series G of Cayley trees at a = 3/10, we use their 
domination by Catalan trees. While 3/10 is larger than the radius 1/4 of convergence of the generating 
series of Catalan trees, the computation of (5(3/10) can be done by the hybrid method, as soon as K > 1. 
With K = 2 and a precision 10~^° we get M = 16 while K — A leads to a smaller M ~ 7. With these 
values the numerical computation of the Polya operator for sets uses at most 36 terms of the sum in 
Lemma 9.16 and leads to the values given in Example 23. 

Optimized Newton iteration The preceding methods for numerical evaluation also apply in the case 
of the optimized Newton iteration. We just give some examples. 

Example 27. The exponential generating series of Cayley trees is evaluated in Example 21 by the simple 
Newton iteration: 

^ + l-ae^'"' ■ 

The optimized iteration is 

^[n+l] ^ ^[n] ^ _ ^N)^ ^[n+1] ^ ^[n] ^ yN(c,e*"\["l - + 1), 

both with initial value i^"! ~ 0, and m!''! = 1; the latter one trades one division for one multiplication. 
For a = 1/10, the first few values are: 

0. 1 1000000000000000000, 
0.11183139629772798888, 
0.11183255915822437627, 
0.11183255915896296483. 

The convergence is mildly slower, but still quadratic and the complexity is slightly smaller. The real gain 
of this method is for systems, where inverses of matrices can become expensive. 

Example 28. For series-parallel graphs, the optimized iteration is given in the introduction to this article. 



10 Extensions 

In this section, we discuss two extensions of our work. 

In the first part, we generalize and extend our results to combinatorial systems including integrals. We 
define well-founded integral systems, that possess a unique linear species solution and we adapt Newton's 
iteration to their resolution, with quadratic convergence. From there, we compute the generating series 
with quasi-optimal arithmetic complexity. This framework also provides an efficient way to compute with 
equations involving Set and Cyc, by expressing them in terms of simple differential equations (without 
exponentials or logarithms). 

The second extension deals with the construction Powerset, which is not a species per se, but is 
amenable to Newton iteration nonetheless. 
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Figure 16: Representation of an J J^-structure. 



10.1 Linear Species and Differential Equations 

Combinatorial differential equations can be stated for classical species, but such a simple equation as 
y = ZSet(Z), 3^(0) = does not have a solution, and others may have an infinite number of solutions 
(this is proved by using a decomposition in molecular species [18]). A nicer framework is provided by 
linear species, that make use of a linear order on the underlying set, and it is possible in this framework 
to define structures such as alternating permutations or increasing rooted trees. 

A concise presentation of linear species is given in the last chapter of [2]. We summarize here the 
salient points. Compared to Definition 1.1, the differences are that the finite sets U are endowed with 
a total order and the bijections preserve orders. The automorphisms become trivial and there are no 
unlabeled structures. Only exponential generating series are used and two linear species are isomorphic 
if and only if their exponential generating series are identical. Any classical species gives rise to a linear 
species by restricting it to totally ordered sets and increasing bijections, and we keep the same name and 
notation for sets, cycles,. . . . Composition, derivative, as well as sum, product and more general multisort 
linear species are defined by paying attention to the order. With the new definitions for these operations, 
the exponential generating series still satisfy the same equations as before. 

A new important operation on linear species is combinatorial integration, defined by 

iiU ^ 0, 

J-[U \ {mm{U)}], otherwise. 

A graphical representation of an J J-'-structure is given by Figure 16. The exponential generating series 
of !F{T)dT is JJ" F{t) dt. Indeed, the number of structures of size n + 1 (including the minimum) in 
the combinatorial integration is /„; thus the exponential generating fimction is ^ /« (^Tj^iyT = / /nflT' 

Example 29. Alternating permutations. Any permutation a can be written as a word whose ith 
letter is ^{i). One can then associate a tree to a, with min((T) at the root and the left and right 
subtrees constructed from the factors on the left and on the right of min((T). In this bijection, alternating 
permutations, i.e., of the form a{\) > a{2) < (7(3) > cr(4) < • • • are in correspondence with binary 
increasing trees (binary labeled trees whose labels increase along each branch). These trees satisfy the 
equation B = Z + J B'^. Their exponential generating series satisfies B' = 1 + B"^ and B{0) = 0, so that 
B{z) = tan(z). 

The following two examples show how to express Cyc and Set in terms of differential equations. These 
expressions are used, in particular, to get the complexity of constructible species in a self-contained way, 
in Proposition 8.14. 

Example 30. Cycles. The equation for Cyc(^) is obtained as the integral of its derivative (see Table 1): 

cyc{A{z))^ f SEQ{A{r))A'{r)dr. 

Jo 

Thus the computation of the generating series is obtained simply by expanding 

Jo 
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This is a special case of the classical way of computing the power series expansion of log(M) as the integral 
of its derivative. 

Example 31. Sets. When viewed as linear species, sets satisfy an integral equation, again obtained as 
the integral of their derivative. If ^ is a species such that -4.(0) — 0, then the species Set(,4.) satisfies 

Set(.4.(^)) = 1 + / SET{A{T))A:{T)dT. 
Jo 

The algorithms developped in this section solve such equations and thus provide fast ways of computing 
the "exp" needed in the computation of the exponential generating series for Set, and we will show 
more generally how to compute the composition exp(u) where u is a power series, so that the ordinary 
generating series of Set can be computed efficiently too. 

The rest of this section is devoted to the resolution of integral systems. The first step is to define 
general combinatorial integral systems over linear species, and find suitable conditions ensuring that they 
have a solution which is unique up to isomorphism : this is done in 10.1.1, relying on previous work 
by Leroux and Viennot. Then in 10.1.2, generalizing a result by Labelle, we define Newton's Iteration 
for integral system and show that the solution of the linearized system doubles the precision. Newton's 
Iteration reduces a non linear problem to a linear integral system. In order to solve linear integral 
system, we propose in 10.1.3 a Variation of the Constant method, which applies to homogeneous and non 
homogeneous, and finally results in an efficient algorithm for the resolution of general well-founded integral 
systems by Newton's Iteration in 10.1.4. Some examples are given in 10.1.5, showing that specifications 
containing Set and Cyc can be transformed into integral systems with rapid enumeration algorithms. 

10.1.1 Well-founded Integral Systems 

With the combinatorial integration operator, integral systems over linear species can be defined. It turns 
out that they are all "well founded" in the sense that they define unique linear species, and we show a 
general implicit theorem for integral systems in 10.3. Our result relies on a proposition due to Leroux 
and Viennot, concerning purely integral systems: 

Property 10.1. [23] For arbitrary linear species Wi, . . . , Wm, the system 

y,{z,x) = x,+ ( m{T,y{T,x))dT, i = i,...,m (20) 

Jo 

has a linear species solution that is unique up to isomorphism. 

The solution is called a W-enriched increasing rooted tree. Many other systems, including higher- 
order differential or integral equations, can be reduced to the form of the theorem by adding new variables. 
This property shows that, thanks to the integral, all systems of type (20) are unconditionally well founded. 

We now extend this result in two directions: first we generalize these integral systems to systems 
admitting a non-integral part, so that the implicit species theorem is also a special case; next, we consider 
well-founded systems of that type. 

Proposition 10.2. Let Hi-.m o,nd Qi-.m be vectors ofm + 1-sort linear species such that 7i{0, 0) = and 
d'H/dy{0,0) is nilpotent. Then the system 

y{z) = mz, y{z)) + [ g{T,yiT)) dr 

Jo 

has a linear species solution S such that S{0) — 0, that is unique up to isomorphism. 

Instead of proving this result, we proceed directly to the following more general one that encompasses 
the general implicit species theorem as well. Apart from technical conditions ensuring that all composi- 
tions with species that are not at are possible, the idea consists in reducing to an integral system of 
the type (20). 
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Theorem 10.3 (Well-founded integral systems). Let Hi;m and Qi;m he vectors of m + 1-sort linear 
species. The system 



y{z)^'H{z,y{z))+ I giT,y{T))dT 

JQ 



(21) 



admits a linear species solution S such that <S(0) — 'H™(0, 0), that is unique up to isomorphism when 
the following two conditions hold: 

1. d'H/dy{0,O) is nilpotent; 

2. ifn{0,O) ^ then 

(a) 7i{0,y) is polynomial and dH I dy{Q,y) is nilpotent; 

(b) ifTZ- is the solution of y — 7^(0, y) then for all i € {1, . . . , m}, either TZi — or the solution 
of (20) is polynomial in Xi, with W solution of the implicit system 

2 = ay^^'^^ ■Q + ^{z,y) + G{zy). (22) 

A system satisfying these conditions will he called well-founded. 
Proof. Differentiating (21) (see (4)) gives 

y'{z) = — (z, y) ■ y'{z) + — (z, y) + g{z, y), 

which shows that the derivative of the solution satisfies (22). Since dH/dy{0, 0) is nilpotent, the implicit 
species theorem 2.1 implies that the related linear system 

u{z, X, y) = dn/dy{z, y) ■ u{z, x, y) + x, (23) 

with X a vector of sorts, is well founded. Its solution is polynomial (even linear!) in AT, so that the 
composition with X ~ j^{Z,y) + Q{Z,y) is possible, giving a solution y\^{Z,y) to (22). Moreover, 
such an equation has a unique solution, since Eq. (23) with Af = is well founded. Thus y' = W(Z, y) 
and the system (21) rewrites 



y{z)^y{o)+ I yv{T,y{T))dT. 

Jo 



By Property 10.1, the same system with the sorts Xi-m in place of yi:m{0) has a linear species 
solution Viz, X). Now, if S{Z) is a solution of (21), then 5(0) satisfies the equation y = ?i(0, y). This 
equation is well founded as a consequence of condition 2. (a) and Theorem 5.5. Thus «S(0) is its solution, 
up to isomorphism. Finally, condition 2.(h) ensures that V{Z,X) can be composed with X = <S(0), 
giving the solution <S(Z) = V(Z,<S(0)). 

Uniqueness up to isomorphism is a consequence of the uniqueness at each stage of the construction. □ 



10.1.2 Newton's Iteration 

We now consider Newton's Iteration by linearizing integral systems. Again we start with the purely 
integral system (20). Newton's iteration has been lifted to this combinatorial level by Labelle: 

Property 10.4 ([18]). Let S he the solution of (20). // a suhspecies ^ C «S has contact of order k 
with S , then the solution of the linearized system 

B^l^j^ ^{A)B^+X+ l^j^ W(^)^ - A (24) 

is such that A + 3 has contact of order 2k with S. 

The following result is a generalization of this property to systems that are well founded in the sense 
of Theorem 10.3. 
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Theorem 10.5 (Newton's iteration for integral systems). Let S be the solution of the well-founded 
system 

y{z)^n{z,y{z))+ f g{T,y{T))dT. (21) 

Jo 

If a subspecies A.<Z S has contact of order k with S , then the solution of the linearized system 



B{Z, + £ ^{T, A{T)) (id |^(r, A{T))^ BiT, X) dT 



(25) 



is such that A{Z) + (id- ^[Z,A[Z))) ^ B {Z,n{Z,A) - A + J Q{A)) has contact of order 2k 
with S . 

Note that setting H = X '\n this theorem yields Property 10.4, while setting Q ^ {) produces Theo- 
rem 6.3. 

Proof. The proof follows the same reasoning as that of Lemma 6.6. Instead of decomposing an «S-structure 
of size at most 2k that is not an ^-structure, we write directly contacts between species: 

s =2fc mz, A) + ||(z, A)-{s-A) + gir, Air)) dT+j^ ||(r, a{T)) ■ {s{t) a{T)) dr. 

Indeed further terms in the Taylor expansions of H and Q are supported only by structures of size at 
least 2k + 2, which reduces to 2A: + 1 by integration. Now, as in Lemma 6.6, a structure hi S — A starts 
with a string of dTi/dy{A). Thus S — A decomposes as (Id — dH/dy{A))~^ • V for a species V that 
satisfies 

V =2k n{z, A)-A+£ g{r, A) dr + £ ^(r, ^(r))(id - |^(z, A))-'v{r) dr. 

This is exactly (25), with X replaced by 7i{Z, A) — A+ J G{A), and the result follows from the uniqueness 
of Prop. 10.1. □ 



10.1.3 Virtual Species and Variation of the Constant 

Newton's iteration reduces the nonlinear problem (20) to the linear integral system (24). In the case of 
one equation, this linear integral equation takes the form 

B=Q+ f VB. 
Jo 

Leroux and Viennot [23] have shown that its resolution can be reduced further to the solution V of 
the homogeneous equation V' = VV by a combinatorial lifting of Lagrange's method of variation of the 
constant: 




using Set in place of the analytical exp and virtual linear species to account for the minus sign in the 
inner integral. Virtual species are presented in [2, §2.5]; they are to species what the relative integers are 
to the natural integers; they let one define the opposite of a species and the reciprocal of a species J^, 
the latter when .^(0) = 1; their generating series obey the same rules as those of the usual species. 

We now apply variation of the constant to systems of equations. In this setting, the linear homogeneous 
system is no longer solved by an exponential (or combinatorially, by a Set) in general. However, fast 
power series expansion via Newton's iteration is still possible in this context as shown in [4]. We lift 
the idea of [4] combinatorially, using virtual species. The key idea is to compute not only a vector 
solution of the homogeneous equation V' = • V used for variation of the constant, but a square matrix 
solution V together with its inverse. The result is summarized in the following statement, where we define 
the valuation of a species as that of its generating series and denote it val(.F). 



53 



Proposition 10.6 (Variation of tlie constant). Let M. be a matrix species solution of y' = Ay, with 
y{0) = Id and let W C Ad have contact of order k with Ad. Let 3 he a species with valuation at least I. 
Then the species W / W~^B has contact of order k + £ + 1 with the solution S ofy'— Ay + 3. 

Proof. First, we observe that the valuation of AW — W' is at least k. Indeed, the difference Ad — W 
has valuation at least fc + 1 by definition of contact and valuation. This valuation docs not decrease when 
multiplying by A on the left, while it decreases by 1 by differentiation. 

Next, since W(0) = Id, the valuation of W is and moreover, a virtual species U is defined by 
S = yVU. Injecting into the differential equation yields 

W'U + WW = AWU + B, 

W = w^B + yv^\Aw - yv')u, 
j yv^B + j yv-\Aw -W)u. 

The valuation of the second integrand is at least + fc + val(W), the first term coming from W~^, the 
next one from AW — W'. Consequently, the second integral has valuation at least 1 + fc + val( U), while 
val(W) is given by the first integral as being at least £ + 1. In summary, 

U =k+i+i J W^B, 

which implies S ^k+i+i VV JW^^B, concluding the proof. □ 

As a first application, we get a quadratically convergent iteration to the solution of the homogeneous 
system itself. 

Corollary 10.7. Let Ad be a matrix species solution ofy' — Ay, with y{0) — Id and let W C Ad 

have contact of order k with Ad. Then 



W + W j W-\AW -W) 



has contact of order 2fc + 1 with Ad. 

Proof Set Ad := yV +U, then U satisfies W = AU + {AW - W) and the result follows from the 
previous proposition. □ 



10.1.4 Resolution of Integral Systems by Newton's Iteration 

At this stage, our aim is to solve (21). We proceed as in the optimized Newton iteration of §6.3 by setting 
up an iteration that converges to its solution S, but also to related quantities. 

The result is the following generalization of both Prop. 6.9 (in the case of linear species) and Prop. 10.4. 

Theorem 10.8 (Resolution of Integral Systems) . Let S be the solution of the well-founded integral system 

y{z)^n{z,y{z))+ [ g{T,y{T))dT. (2i) 

Jo 

Let also U be the species (Id — dH/ dy{Z,S))^^ , A be the species ^{Z,S)tl and Ad be the virtual 
species solution of Ad' = AAd with Ad{0) = Id. For a positive integer k, assume that u,m,ra have 
contact of order [fc/2j with Vl,Ad,Ad^ and that s has contact of order k with S. Then 

• u :~ u + u{^^{s)u + Id — m) has contact of order k with U; 

• rh := ra J ffi{^ {s)um — m!) has contact of order k with Ad; 

• fn := m + m(Id — mm) has contact of order fc with Ad^^ ; 
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• s + iirh J m{^^{s) + ^^{s)s' — s' + Q{s)) has contact of order 2k with S. 

Proof. The result for u is the familiar Newton iteration for matrix inverses of (9). The contact follows 
from the fact that s and S having contact of order k implies that so do (s) and (<S). The result for 
m is a consequence of Corollary 10.7, where again, the use of ^{s)u instead of ^{S)U is made possible 
by their contact being of order k. The result for m is again Newton's iteration for matrix inversion. 

The last formula is where we exploit the work done up to now. Newton's iteration for integral systems 
(Thm. 10.5) implies that S — s has contact of order 2k with the product (Id — (s))~^ • b where b is 



the solution of 



dQ , du, ,,1, , du, , an, 



= ^'^^^^'^'^-dy^^^^''^ + 1 9 = ^(^) + ^(s)^'-s' + a(s). 

Due to differentiation, q has contact fc~l with its counterpart in S, which is 0. Its valuation is therefore at 
least k. Then by variation of the constant (Prop. 10.6), rh Jrnq has contact of order 2k + 1 with b. Now, 
by integration, b has valuation at least k + 1 and thus ub has contact of order 2k with (Id — (s))^^ • b 
and therefore with S — s, which concludes the proof. □ 

This theorem translates into Algorithm newtonScriesIntegralSystem, an analogue of Algorithm new- 
tonSeries p. 35 for generating series. 

In terms of complexity, we get the following result. 

Proposition 10.9. Let y{Z) ~ 71(2, y) + Q (T , y (T)) dT be a well-founded system such that Q, 
dH/dZ. dH/dy , and dQ /dy are linear species with arithmetic complexity C{N). Then the generating 
series of the linear species S solution of the system can he computed in arithmetic complexity 0{C{N) + 
M(7V)). 

Note that this is not a generalization of Theorem 8.15: while we obtain the desired complexity for 
the generating series of S, we do not claim that for any linear species A.^ the generating series of the 
composition S{A) can be obtained within the same complexity bound. 

Proof. The recursion of Algorithm newtonScriesIntegralSystem is correct by the previous Theorem. Its 
complexity T{N) obeys the recurrence 

T{N) = T{N/2) + 2C{N/2) + 2C{N) + KM{N) + 0{N), 

where K counts the number of products involved. Since C{N/2) = 0{C(N)), this behaves as in the proof 
of Theorem 8.15 and leads to the result. □ 

The special case of interest is that of constructible species: 

Theorem 10.10. IfH andQ are constructible species such that the system (21) is well founded, then the 
solution of this system has a generating series that can be computed in 0{M{N)) arithmetic operations. 

Proof. This is a consequence of the previous result, the observation that the derivatives of constructible 
species are constructible and the arithmetic complexity of constructible species (Cor. 8.16). □ 



10.1.5 Examples 

Exponential The equation for Set(^) is 

y{z)^i + r A'{r)y{r)dr. 

Jo 

The specialization of Algorithm newtonScriesIntegralSystem retrieves a recent algorithm for the compu- 
tation of the power series exp{A{z)) given A{z) [13], see also [3]. In that case no matrices are involved 
(the dimension is 1), U = 1 and we are left with the following recursive part: 

m :~ m + m / rn{A' {t)m ~ m') dt, m := m + m(l — mm). (27) 
Jo 

In this case, as in all the linear cases (i.e., when ft is a constant), it is not necessary to compute the 
iteration for y: this iteration reads y :— y + m m{A'{t)y — y') dt so that an easy induction shows that 
y = ■my{0). 
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Algorithm newtonSeriesIntegralSystem: Computation of generating series with 
a given precision 



Input: Two vectors of species H and such that 

y{Z) = n{Z, y{Z)) + g{Z, y{T)) dT is well founded 
Input: An integer N 

Output: The first N terms of the generating series S{z) of the hnear species solution 
begin 

Set up a procedure sG: {Y{z),N) ^ G{z, Y{z)) mod 
Set up a procedure sJ: (y(z),iV) ^ dH /dY{z,Y{z)) mod z^ 
Set up a procedure sK: {Y{z),N) ^ dG/dY{z, Y{z)) mod z^ 
Set up a procedure sL: {Y{z),N) i-> dH/dz{z, Y{z)) mod z^ 

II G^H are the generating series of Q^H 
U, M, M, Y:^ recSeries (A) 
Return Y 
end 

Function recSeries 
Input: An integer A 

Output: U: (Id - dU/dy{z, S{z)))~^ mod z^^/^l 

Output: M: solution of Y' {z) = dg/dy{z, S{z))U{z)Y[z) with F(0) = Id, 
mod 

Output: M: M^Sxiod z^^/^T 
Output: 1": S{z) mod 
begin 

if TV = 1 then M := M := Id; Y := i?'"(0, 0); [/ := (Id - J(0, y))"! 
else 

U,M,M,Y := recSeries (rA/2]) 

[/:=[/ + J7 • (s J (r , [A/2] ) -U + Id- U)) mod z 

M ■=M + M M(sK(Y, rA/2] )t/M - M') mod z^^/^l 

M := M + M(Id - MM) mod z^^/^T 

y := 

r + t/M /J' M (sL(y, A) + S J(r , N)-Y' -Y' + sG{Y, A)) mod 

return U,M,M,Y 
end 
end 



Cayley Trees The generating series of Cayley trees (3^ — ZSet(3^)) has been computed in Example 17 
appealing to an external "exp" for power series. This can be achieved by using the iteration of (27). 
Another approach, without exponential, is to use the following system: 



yi = zy2, 3^2 = 1 + Jy[y2- 



This is not strictly in the format required, since the integral involves a derivative of 3^i. Introducing 3^3 
to represent y[, we obtain the following system 

3^1 = 23^2, 3^2 = 1 + J 3^33^2, 3^3 = 3^2 + 23^23^3- 

It is thus only necessary to compute 3^2 and 3^3 recursively, since 3^i is then simply recovered by multi- 
plication by Z. In the notations of Theorem 10.8, we have 

^ 13^2+2^23^3/' ^ I 
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The iteration for generating series then reads 



M := M + M ■ I M ■ i^^ ^^\-U -M ~M\ 



M := M + M ■ (Id - M ■ M), 
Y :=Y + U ■ M ■ M ■ 



Y2Y3 - 

Y2Y3 + (1 + 21-3)^2' + (zY^ - 1)Y^ 

The only costly operations needed are products of power series, the other ones (addition, differentiation, 
integration) having linear complexity. Several of the entries of the Jacobian matrices are 0, so that not 
that many products are actually used in the iteration. 

Mobiles These "trees" are defined by y — Z + J Cyc(3^): to the root is attached a cycle of similar 
trees, the labels increasing along the "branches". These were studied in [f] from the asymptotic point 
of view. The generating series does not appear to have a nice closed form. It satisfies the differential 
equation 

y(z) = z + |log^-^dt. 

The species equation is reduced to purely elementary operations by introducing new species for CYC(y) 
and using the fact that y' = 1 + CYC{y), so that we consider 

yi = z + Jy2, 3^2- J SEQ{yi){i + y2). 

Now, in the notations of Theorem 10.8, we have 

^"(0)' {sEQ{y^){i + y2] 

This is very similar to the previous example. The general recursion simplifies: since H does not depend 
on y the matrix U is Id. Thus we are left with the recursion 

M := M + M ■ [ll ■ ( i+Y^ 1 



J \{l~Yi)^ 1-Yi 

M := M + M • (Id - Af • M), 

1 + - Y( 

1-Yi -^2 



Y ■.= Y + M ■ J M ■ 
Starting with initial value y = 0, we get successively 

1 2 





— Z 


ym 


= z 


ym 


= z 


yW 


= z 



5 1 o 7 4 3 , 49 fi 173 7 21059 
^ + + 3^ + 24^ + 10^ + I44^ + 420^ + 40320^ 



More terms are easily obtained: each iteration has the cost of a few multiplication of power series. A 
small constant factor could further be saved by introducing another variable for Seq(3^i) so as to avoid 
the computations of the inverses of 1 — Yi. 
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10.2 Powersets 



The constructible classes of [10] also involve a construction called PowerSet, which is not a species per se. 
We show in this section that Newton's iteration can still be applied to species defined with it. 



10.2.1 Definition 

When counting unlabeled structures, the species Set lets multiple identical unlabelled structures be 
counted. The principle of the PowerSet construction, abbreviated PSet, is to remove duplicates. An 
alternative construction, inspired by "Vallee's identity" [10, p. 30] is as follows. Given a species the 
equation 

Set(J-(Z)) ^ V{Z) ■ Set(J-(z2)) 

defines a virtual species V that we denote PSet(J^). The intuition is to decompose the groups of 
duplicates according to their parity. Note that PSet is not a species (this is shown by examples below), 
but rather a mapping sending species to virtual species. 



10.2.2 Generating Series 

By Property 8.5, the cycle index series of V satisfies 

■^Set(J^)(^1, ^2, 23, . . . ) = Z-p(zi, Z2, Z3, . . . )^Set(J^)(z?, zl, zj,... ), 

SO that 

Zv{zi,Z2, 2:3, • • ■ ) = exp I ^ ^Zjr{zk,Z2k, zsk, ■ • • ) ) ' ^xp ( - ^ ^Zjr(zl, z^f., zl,., , 

\fc>0 / V fc>0 



Setting Zk = z^ yields the ordinary generating series 

P{z) — exp 

which simplifies to 



iT.\nz')-T.\nz'')]^ 

\k>0 k>0 / 



P(z)=exp(5]^^^/'(z'^)). 

\fc>o / 

Thus we recover the classical formula used by [10]. A simple consequence is the following. 

Lemma 10.11. Ij the species J- has ordinary arithmetic complexity Cp, then the species PSet(J^) has 
ordinary arithmetic complexity Cp + 0(M). 

Proof. The argument is the same as for sets and cycles in the proof of Proposition 8.14. □ 

Exponential generating series can be computed as well. Substituting zi = z and z^ — Q for A; > 1 in 
the cycle index series gives 

P{z) =exp{F{z) - F{z^)). 

For instance, the special case T = Z leads to exp(z — z^) = 1 + z — z^/2 + O(z^). The presence 
of a minus sign shows that PSet(Z) is a virtual species that is not a real species. Also, the fact 
that P{z) ^ exp(F(z) — F(z)^) in general shows that PSet is not a species, for otherwise exponential 
generating series would compose. 
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10.2.3 Newton's Iteration 

Since PSet is not a species, its derivative is not defined, so that another approach is needed for Newton's 
iteration. The idea is to perform a first order Taylor expansion of Set on both sides of 

Set(J-(Z) +Z^(Z)) = PSet{T + U) ■ Set{T{Z^)+U{Z^)). 

If U =k then U{Z^) =2k+i U{Zf =2k+i 0, whence 

Set(.F(Z)) • (1 + U{Z)) =2fc+i PSet(^ + U) ■ Set(^(z2)) 

and thus 

Y>Set{F + U) =2k+i PSet(J-) • {l+U). 

This is the key identity in the proof of the quadratic convergence of Newton's iteration. Thus, PSet 
behaves as if it had itself for derivative, exactly like Set, and the same iteration as for Set converges 
quadratically. 

10.2.4 Example 

When is a flat species (see Section 7.2), then PSet(J^) is also equal to the flat part of Set(J^). Thus 
in this case, we recover species that can also be enumerated by the method of asymmetry index series^ 
for which we refer to [2, §4.4] and [21]. 

An example of this type is provided by asymmetric rooted trees, with equation A — Z- PSET(y^). By 
application of the general rule outlined above, Newton's iteration is the same as for Cayley trees (Ex. 15), 
with the species Set replaced by the mapping PSet: 

N{y) = y + SEQ.{B)-{B-y) with s = z • psetC^'). 

The associated Polya operator is given by 

<^M^ : Y{z) ^ Y{z) + ^[^1^1^)^^ with i?(z) = zexp(^y(z)- V(z2) + ...j. 

The flrst few steps give: 

= z + z^ + z'' + + + + + + + + z" + + . . . ^ 
G^^i = z + + + 2z'* + 3z^ + 6z^ + 12z^ + 25z^ + 52z'' + lllz^" + 237z" + SOTz^^ + ^ 
G[31 = z + z^ + z^ + 2z'* + 3z^ + 6z^ + 12z'^ + 25z^ + 52z'' + 113z^° + 247z^^ + 548z^^ H . 

Thus we recover a classical sequence [2, p. 330] for which we obtain the first terms in quasi-optimal 
complexity. 
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